-- Logs begin at Tue 2021-11-16 02:37:37 UTC, end at Tue 2021-11-16 03:37:28 UTC. -- Nov 16 03:03:03.762296 dv-cinder-818037-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 16 03:03:03.772911 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Nov 16 03:03:03 2021] *** Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: nodename: dv-cinder-818037-1-iscsi Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: machine: x86_64 Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: clock source: unix Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: pcre jit disabled Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: detected number of CPU cores: 4 Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: current working directory: / Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: detected binary path: /usr/bin/uwsgi-core Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: your processes number limit is 47680 Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: your memory page size is 4096 bytes Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: detected max file descriptor number: 2048 Nov 16 03:03:03.775108 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: lock engine: pthread robust mutexes Nov 16 03:03:03.776040 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: thunder lock: enabled Nov 16 03:03:03.776040 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 16 03:03:03.776040 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 16 03:03:03.820550 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: Python main interpreter initialized at 0x55600d2f39c0 Nov 16 03:03:03.820550 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: python threads support enabled Nov 16 03:03:03.820550 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: your server socket listen backlog is limited to 100 connections Nov 16 03:03:03.820550 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: your mercy for graceful operations on workers is 90 seconds Nov 16 03:03:03.820941 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: mapped 403077 bytes (393 KB) for 2 cores Nov 16 03:03:03.820941 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: *** Operational MODE: preforking *** Nov 16 03:03:03.821273 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: *** uWSGI is running in multiple interpreter mode *** Nov 16 03:03:03.821273 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: spawned uWSGI master process (pid: 79337) Nov 16 03:03:03.821517 dv-cinder-818037-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 16 03:03:03.823912 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: spawned uWSGI worker 1 (pid: 79350, cores: 1) Nov 16 03:03:03.823912 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: spawned uWSGI worker 2 (pid: 79351, cores: 1) Nov 16 03:03:03.823912 dv-cinder-818037-1-iscsi devstack@keystone.service[79337]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 16 03:03:09.002989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:03:09.002989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: from cryptography.utils import int_from_bytes Nov 16 03:03:09.003825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:03:09.003825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: from cryptography.utils import int_from_bytes Nov 16 03:03:09.003927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:03:09.003927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: from cryptography.utils import int_from_bytes Nov 16 03:03:09.003927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 16 03:03:09.003927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: from cryptography.utils import int_from_bytes Nov 16 03:03:09.053968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 03:03:09.054180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 03:03:09.054312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] command line args: [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 03:03:09.054611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 03:03:09.054747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 16 03:03:09.054832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ================================================================================ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 03:03:09.054899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 16 03:03:09.054963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] command line args: [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 16 03:03:09.055028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] admin_token = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.055251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 16 03:03:09.055381 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config_dir = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.055461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ================================================================================ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 16 03:03:09.055528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.055592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] config_source = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.055654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] admin_token = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.055801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] debug = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.055887 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config_dir = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.055952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.057709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.057709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] config_source = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.057833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.057893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] debug = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.057951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_config_append = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_dir = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_config_append = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.058982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_dir = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.059945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.060940 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.061070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.061198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.061284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.061460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.061772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.061891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.061983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] publish_errors = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.31/identity {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] publish_errors = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.062945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] standard_threads = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] standard_threads = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.063966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_journal = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_json = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_stderr = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] use_syslog = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.064924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.065005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_journal = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.065076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.065153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_json = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.065307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_stderr = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.065453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.065629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] use_syslog = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.065706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.065782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 16 03:03:09.065853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.065997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066135 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.066979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067456 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.067935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.068972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069197 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.069950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.070935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.071900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.072996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.073956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.074972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.075912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.076907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.077083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.077202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.077386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.077555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.077686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.077806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.077920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.078934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.079970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.080139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.080284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.080540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.080694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.080799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.080911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081012 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.081858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.082957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083490 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.083963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084872 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.084989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.085101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.085222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.085222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.085533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.085660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.085773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.085883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.086933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.external = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.087943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.external = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.password = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.088997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] auth.token = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089108 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.password = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] auth.token = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.089919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.090938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.091910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.092936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.093916 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.094960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.095071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.095183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.095410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.095578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.095702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.095932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.096929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.097959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.098986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.099904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.100934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101395 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.101880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.102926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.103955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.104955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.105891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.106926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.107951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.108860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.109937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.110816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.111049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.111251 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.111419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.111543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.111659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.111773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.111898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.112928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.113874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.114937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.115967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.116887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.117929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.118964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.119077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.119236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.119351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.119542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.119658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.119772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.119892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.120919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.121902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.122924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.123955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.124987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.125130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.125245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.125384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.125521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.125665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.125794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.125911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.126025 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.126139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.126312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.126431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.126554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.126669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.126899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.127963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.128996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.129957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.130988 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.131922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.132983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.133938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.134899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.135983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.136947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137450 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.137939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.138051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 03:03:09.138164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.138350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.138466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 16 03:03:09.138628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 16 03:03:09.167992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.168200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.168436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.169037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.169269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.169532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.177222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.178534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.208211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.208422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.210604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.210835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.357629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.358777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.407211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.407419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.407496 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.407781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.476835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.477893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.478012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.478092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.478092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.501761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.501972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.502984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.503060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.503167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.503372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.514608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.514780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.527869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.528995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.529147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79350) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.529272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79351) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 16 03:03:09.547068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.547263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 03:03:09.547609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.547733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.547817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 03:03:09.547893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 03:03:09.548064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.548236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.548367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.548489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 16 03:03:09.548657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.548862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.549017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.549306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.549614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.549877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.560466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.560750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.561018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.561296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.562979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.563262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.563523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.563889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.569667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.572533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.572890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.573172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.573479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.573759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.574041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.574295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.574567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.574837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.575104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.575348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.575645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.575767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.576000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.576281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.576558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.576931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.577091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.577359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.577656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.577923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.578187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.578434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.601581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.603180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.603461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.605161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.606803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.607081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.608661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.608879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.609160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.612693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.612972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.613256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.616560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.616846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.620527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.620811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.621208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.621515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.621799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.622074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.622346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.622616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.622881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.623128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.625142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.625449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.625728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.626003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.626356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.626782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.627226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.627483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.641877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.642159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.646048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.646324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.646669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.650240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.650533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.650725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.654269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.654562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.655583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.659188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.659911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.663221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.663518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.663760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.663883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.664042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.664358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.664643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.667315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.667607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.667894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.668162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.668442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.668725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.685069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.685304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.685630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.685892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.689530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.689822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.690086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.690353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.693700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.695377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.695653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.698026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.698802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.699090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.699383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.699660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.699783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.699983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.700113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.703089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.703367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.703614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.703917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.704187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.712957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.713217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.713547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.713834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.714110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.714378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.714648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.717569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.717848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.718143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.718408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.718683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.718955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.719206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.732769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.736202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.737870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.739467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.741055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.741183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.742842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.743133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.743406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.744295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.745886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.747610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.747889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.748163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.750517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.752172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.755367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.755619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.755742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.755875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.756180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.757201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.760375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.760658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.760933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.761203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.765226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.765546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.765818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.770533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.770820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.771148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.773554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79350) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.773836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.774120 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.774403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.774672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.774939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.775210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.775453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.775863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.776152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.776407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.776672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.776934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.777176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79350) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.778819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79351) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 16 03:03:09.779118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.779383 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.779668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.779930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.780195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.780463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.780754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.781124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.781411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.781685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.781949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.782209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.782540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79351) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 16 03:03:09.814824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55600d2f39c0 pid: 79350 (default app) Nov 16 03:03:09.818417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4127-5269-41c2-a882-c7e9387d5d16 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:09.818714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4127-5269-41c2-a882-c7e9387d5d16 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:09.818990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4127-5269-41c2-a882-c7e9387d5d16 None None] PATH_INFO: `/v3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:09.820981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55600d2f39c0 pid: 79351 (default app) Nov 16 03:03:09.823352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1/1] 10.222.0.31 () {50 vars in 791 bytes} [Tue Nov 16 03:03:09 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:17.599440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa521-997c-4d08-8be9-38d565222c55 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:17.599986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa521-997c-4d08-8be9-38d565222c55 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:17.599986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa521-997c-4d08-8be9-38d565222c55 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:17.605145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1/2] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:17 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:17.611688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:17.612177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:17.612395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:17.643813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG oslo_db.sqlalchemy.engines [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 03:03:17.834980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG passlib.handlers.bcrypt [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79350) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 16 03:03:17.835411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG passlib.handlers.bcrypt [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79350) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 16 03:03:17.890748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:17.892477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:18.033531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 2/3] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:18.079689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa521-997c-4d08-8be9-38d565222c55 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:18.115117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG oslo_db.sqlalchemy.engines [None req-aa2aa521-997c-4d08-8be9-38d565222c55 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 16 03:03:18.249849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa521-997c-4d08-8be9-38d565222c55 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:18.254765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416453b6-3def-4763-a564-c538dbdb1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:18.255450 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416453b6-3def-4763-a564-c538dbdb1f1a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:18.255740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416453b6-3def-4763-a564-c538dbdb1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:18.256017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416453b6-3def-4763-a564-c538dbdb1f1a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:18.264984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416453b6-3def-4763-a564-c538dbdb1f1a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:18.315519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.common.rbac_enforcer.enforcer [None req-416453b6-3def-4763-a564-c538dbdb1f1a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 16 03:03:18.315851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416453b6-3def-4763-a564-c538dbdb1f1a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:18.326013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 2/4] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:03:18.333123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:18.347961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c6c76-e347-4796-9a61-414fb0d8c519 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:18.355020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffcb29-e818-466b-9527-e76bec0f774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:18.356216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcb29-e818-466b-9527-e76bec0f774c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:18.356503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcb29-e818-466b-9527-e76bec0f774c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:18.356786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcb29-e818-466b-9527-e76bec0f774c admin admin] PATH_INFO: `/v3/projects/fb897d934c0d40faa98082f63fe4c388` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:18.358415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffcb29-e818-466b-9527-e76bec0f774c admin admin] RBAC: Authorizing `identity:get_project(project_id=fb897d934c0d40faa98082f63fe4c388)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:18.410458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.common.rbac_enforcer.enforcer [None req-40ffcb29-e818-466b-9527-e76bec0f774c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 16 03:03:18.410797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffcb29-e818-466b-9527-e76bec0f774c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:18.416154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 3/5] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:18 2021] GET /identity/v3/projects/fb897d934c0d40faa98082f63fe4c388 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:20.734317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7463-0bbf-4fdd-a5d1-cb380b61c756 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:20.734994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7463-0bbf-4fdd-a5d1-cb380b61c756 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:20.734994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce7463-0bbf-4fdd-a5d1-cb380b61c756 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:20.739659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 3/6] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:20.747190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f5f2e-fa0b-40f3-9118-58c67f59d515 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:20.747705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f5f2e-fa0b-40f3-9118-58c67f59d515 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:20.747705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f5f2e-fa0b-40f3-9118-58c67f59d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:20.767669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-dc7f5f2e-fa0b-40f3-9118-58c67f59d515 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:20.769237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dc7f5f2e-fa0b-40f3-9118-58c67f59d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:20.778048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 4/7] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:20.802836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7463-0bbf-4fdd-a5d1-cb380b61c756 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:20.818892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce7463-0bbf-4fdd-a5d1-cb380b61c756 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:20.823681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7bfcf-b0af-4766-bd60-f766ebe30455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:20.824339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7bfcf-b0af-4766-bd60-f766ebe30455 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:20.824620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7bfcf-b0af-4766-bd60-f766ebe30455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:20.824895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7bfcf-b0af-4766-bd60-f766ebe30455 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:20.833903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7bfcf-b0af-4766-bd60-f766ebe30455 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:20.835724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7bfcf-b0af-4766-bd60-f766ebe30455 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:20.844587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 4/8] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:20.851564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f5f2e-fa0b-40f3-9118-58c67f59d515 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:20.861188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f5f2e-fa0b-40f3-9118-58c67f59d515 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:20.867034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09abc7d-d256-4b10-9433-5438d3230339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:20.867932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09abc7d-d256-4b10-9433-5438d3230339 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:20.868217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09abc7d-d256-4b10-9433-5438d3230339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:20.868492 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09abc7d-d256-4b10-9433-5438d3230339 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:20.870128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09abc7d-d256-4b10-9433-5438d3230339 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:20.872027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09abc7d-d256-4b10-9433-5438d3230339 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:20.873736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 5/9] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:20 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:23.330820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf713-ea3d-4450-95ec-7c1c688f5e7b None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.331653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf713-ea3d-4450-95ec-7c1c688f5e7b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.331653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bf713-ea3d-4450-95ec-7c1c688f5e7b None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.333130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 5/10] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:23.335507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d964ed9-82cb-4a51-97d5-6b619aaf49c4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.335963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d964ed9-82cb-4a51-97d5-6b619aaf49c4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.336361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d964ed9-82cb-4a51-97d5-6b619aaf49c4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.339441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 6/11] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:23 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:23.342855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.343139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.343413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.348415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b2ab1-e0b2-4008-a9d1-cf847ae54f0d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.348706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b2ab1-e0b2-4008-a9d1-cf847ae54f0d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.348987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b2ab1-e0b2-4008-a9d1-cf847ae54f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.367987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-972b2ab1-e0b2-4008-a9d1-cf847ae54f0d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:23.369196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-972b2ab1-e0b2-4008-a9d1-cf847ae54f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:23.377638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 7/12] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:23.387787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG passlib.handlers.bcrypt [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79351) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 16 03:03:23.388264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG passlib.handlers.bcrypt [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79351) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 16 03:03:23.402818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b2ab1-e0b2-4008-a9d1-cf847ae54f0d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:23.413220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b2ab1-e0b2-4008-a9d1-cf847ae54f0d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:23.418163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:23.419028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.419373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.419722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.435130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:23.435498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:23.436767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:23.443568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:23.444940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 8/13] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:23.451759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:23.465914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db89da-e971-4449-929b-670f30cc6c16 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:23.466146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 6/14] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:23.473987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:23.475127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.475624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.476463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.477975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:23.478521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:23.481758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:23.481758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:03:23.481758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:03:23.483492 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:23.506862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:23.514273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 9/15] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:23.515900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:23.519727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1c0e6-63bb-4e9f-bcef-1b0abbfe8f6a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:23.526214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:23.527544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.527998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.528451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.538791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ae4aa-2c81-46cb-8447-32883694b014 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:23.543448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:23.546917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:23.550785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:23.552225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.552682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.553131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.555345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:23.558352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:23.561217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 10/16] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:23 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:23.564242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 7/17] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:23 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:03:23.569599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:23.571177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:23.581234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa251fc-be90-4548-b45a-085d59f3ff28 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:23.581611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686176f7-4898-4b38-ad90-d5ca9542c100 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:23.586478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:23.586666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4009c-8d22-40b7-8831-25a733a09a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:23.587414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.587594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4009c-8d22-40b7-8831-25a733a09a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.587793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.587940 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4009c-8d22-40b7-8831-25a733a09a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.588170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.588347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4009c-8d22-40b7-8831-25a733a09a1a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.589539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:23.589994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4009c-8d22-40b7-8831-25a733a09a1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:23.591418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:23.591866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4009c-8d22-40b7-8831-25a733a09a1a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:23.593209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 11/18] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:23.593703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 8/19] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:23.601039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:23.612776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4107022-a247-4711-8e55-d1e96bed5fea admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:23.617966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:23.618728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:23.619076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:23.619409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:23.620357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.domain.id=default, user.id=a95f866674d64e91af100063311f9b6a) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:23.620736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:23.621888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:23.621888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:03:23.621888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:03:23.623303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de760d-04d1-4be1-bac0-7ab108d7220e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:23.633137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 12/20] 10.222.0.31 () {56 vars in 1343 bytes} [Tue Nov 16 03:03:23 2021] GET /identity/v3/role_assignments?user.id=a95f866674d64e91af100063311f9b6a&scope.domain.id=default&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 233 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:26.356432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b463-8db7-435e-af9f-28ac2babdf55 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:26.357952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b463-8db7-435e-af9f-28ac2babdf55 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:26.358790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b463-8db7-435e-af9f-28ac2babdf55 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:26.363458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 9/21] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:26 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:26.371705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc16778-8532-4be8-b7fb-28f273462c9b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:26.373131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc16778-8532-4be8-b7fb-28f273462c9b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:26.373934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc16778-8532-4be8-b7fb-28f273462c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:26.415458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9bc16778-8532-4be8-b7fb-28f273462c9b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:26.418145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9bc16778-8532-4be8-b7fb-28f273462c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:26.436412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 13/22] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:26.476248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b463-8db7-435e-af9f-28ac2babdf55 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:26.494429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b463-8db7-435e-af9f-28ac2babdf55 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:26.499089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:26.499923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:26.500205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:26.500475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:26.522997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:26.530364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:26.537608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 10/23] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:26.539474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc16778-8532-4be8-b7fb-28f273462c9b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:26.549787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc16778-8532-4be8-b7fb-28f273462c9b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:26.554383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:26.555076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:26.555362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:26.555642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:26.556423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:26.556727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:26.558433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:26.573576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 14/24] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:26.575386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:26.586205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526804f7-058d-4559-a31c-33bc28dde94e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:26.590696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:26.591576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:26.591855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:26.592140 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:26.593778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:26.596079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:26.601565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 11/25] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:26 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:26.605073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:26.630797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec90366-60f9-4a3e-a1ad-adac33681868 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:26.647948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ee6ce-18ac-4f26-8e24-c317b0fc87d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:26.649318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ee6ce-18ac-4f26-8e24-c317b0fc87d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:26.649871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ee6ce-18ac-4f26-8e24-c317b0fc87d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:26.650359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ee6ce-18ac-4f26-8e24-c317b0fc87d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:26.653396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ee6ce-18ac-4f26-8e24-c317b0fc87d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:26.656610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ee6ce-18ac-4f26-8e24-c317b0fc87d0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:26.660206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 15/26] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:26 2021] GET /identity/v3/domains/default => generated 199 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:26.667132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:26.683655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464d842-adf5-4be6-bc82-3ab3fc88ad3f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:26.688581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0ec0e-2569-4283-8e54-ff8649036c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:26.694102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0ec0e-2569-4283-8e54-ff8649036c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:26.694611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0ec0e-2569-4283-8e54-ff8649036c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:26.695080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0ec0e-2569-4283-8e54-ff8649036c69 admin admin] PATH_INFO: `/v3/domains/default/users/a95f866674d64e91af100063311f9b6a/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:26.697392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0ec0e-2569-4283-8e54-ff8649036c69 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a95f866674d64e91af100063311f9b6a, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:26.699412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-81a0ec0e-2569-4283-8e54-ff8649036c69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:26.699412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:03:26.699412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:03:26.705869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0ec0e-2569-4283-8e54-ff8649036c69 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:26.869621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 12/27] 10.222.0.31 () {58 vars in 1382 bytes} [Tue Nov 16 03:03:26 2021] PUT /identity/v3/domains/default/users/a95f866674d64e91af100063311f9b6a/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:03:27.496581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4fbd-3fe2-414d-a5bf-d34ea3928578 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:27.497111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4fbd-3fe2-414d-a5bf-d34ea3928578 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:27.497586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e4fbd-3fe2-414d-a5bf-d34ea3928578 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:27.501461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 16/28] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:27 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:27.508406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151bd3-3f8b-4e60-836e-2d4c133b3b9a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:27.509285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151bd3-3f8b-4e60-836e-2d4c133b3b9a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:27.509761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43151bd3-3f8b-4e60-836e-2d4c133b3b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:27.534906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-43151bd3-3f8b-4e60-836e-2d4c133b3b9a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:27.537078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-43151bd3-3f8b-4e60-836e-2d4c133b3b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:27.624355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 13/29] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:27.659148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4fbd-3fe2-414d-a5bf-d34ea3928578 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:27.678117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e4fbd-3fe2-414d-a5bf-d34ea3928578 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:27.685632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:27.686457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:27.686731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:27.687003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:27.706960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:27.708971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:27.742134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:03:27.743574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 17/30] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:27.750317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151bd3-3f8b-4e60-836e-2d4c133b3b9a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:27.760695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43151bd3-3f8b-4e60-836e-2d4c133b3b9a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:27.770341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:27.771360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:27.771860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:27.772358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:27.773314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:27.773837 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:27.775335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:27.775335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:03:27.775335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:03:27.776599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e32e1-ff62-4608-ae0e-6f1b89849922 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:27.809851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 14/31] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:03:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:27.820111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:27.843254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78a0d-1f8f-42a4-90dc-6556249f2b36 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:27.854915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1f9b4-f5d5-412f-a25d-f3e8eb88aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:27.855617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f9b4-f5d5-412f-a25d-f3e8eb88aa6f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:27.855899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f9b4-f5d5-412f-a25d-f3e8eb88aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:27.856174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1f9b4-f5d5-412f-a25d-f3e8eb88aa6f admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:27.856923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1f9b4-f5d5-412f-a25d-f3e8eb88aa6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:27.858007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-86a1f9b4-f5d5-412f-a25d-f3e8eb88aa6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:27.858007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:03:27.858007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:03:27.859365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1f9b4-f5d5-412f-a25d-f3e8eb88aa6f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:28.027611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 18/32] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:03:27 2021] POST /identity/v3/projects => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:28.594641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d2c7e-9373-4412-baa2-8cbd863c47d2 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.596028 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d2c7e-9373-4412-baa2-8cbd863c47d2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.596515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d2c7e-9373-4412-baa2-8cbd863c47d2 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.598582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 15/33] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:28.615979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f511b8-eff3-4f20-8c32-da58678b779c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.616495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f511b8-eff3-4f20-8c32-da58678b779c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.616566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f511b8-eff3-4f20-8c32-da58678b779c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.630863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0375-6616-4ceb-b3b5-e384feec42a6 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.631489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0375-6616-4ceb-b3b5-e384feec42a6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.631995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0375-6616-4ceb-b3b5-e384feec42a6 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.634433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 16/34] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:28.641152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455727-cf2c-4108-a3b7-3fadfbb2e68a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.642091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455727-cf2c-4108-a3b7-3fadfbb2e68a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.642801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455727-cf2c-4108-a3b7-3fadfbb2e68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.646712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-08f511b8-eff3-4f20-8c32-da58678b779c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:28.648333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-08f511b8-eff3-4f20-8c32-da58678b779c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:28.671601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-03455727-cf2c-4108-a3b7-3fadfbb2e68a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:28.677700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-03455727-cf2c-4108-a3b7-3fadfbb2e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:28.733476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 19/35] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:28.760765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 17/36] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:28.802267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f511b8-eff3-4f20-8c32-da58678b779c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:28.806052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455727-cf2c-4108-a3b7-3fadfbb2e68a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:28.816586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455727-cf2c-4108-a3b7-3fadfbb2e68a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:28.819912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f511b8-eff3-4f20-8c32-da58678b779c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:28.822003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece15e0f-f57f-4591-9c3f-b9da532219a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:28.822908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15e0f-f57f-4591-9c3f-b9da532219a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.823388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15e0f-f57f-4591-9c3f-b9da532219a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.823881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece15e0f-f57f-4591-9c3f-b9da532219a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.824867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece15e0f-f57f-4591-9c3f-b9da532219a1 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:28.826145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-ece15e0f-f57f-4591-9c3f-b9da532219a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:28.826145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:03:28.826145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:03:28.828148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece15e0f-f57f-4591-9c3f-b9da532219a1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:28.834217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:28.834690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.835027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.835308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.838341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:28.840511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:28.848419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 20/37] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:28 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:28.850145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:28.862623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 18/38] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:03:28 2021] POST /identity/v3/roles => generated 219 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:28.875374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99935d1b-2eb7-4f56-aac9-e4877add2e70 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:28.881084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862defd-3913-48b6-be9d-7b0f74579246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:28.882201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862defd-3913-48b6-be9d-7b0f74579246 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.882738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862defd-3913-48b6-be9d-7b0f74579246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.883233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862defd-3913-48b6-be9d-7b0f74579246 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.884284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862defd-3913-48b6-be9d-7b0f74579246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:28.890977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862defd-3913-48b6-be9d-7b0f74579246 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:28.935105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 21/39] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:03:28 2021] POST /identity/v3/projects => generated 312 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:28.957989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18b99-c51d-402a-8f5c-3e1c741b5670 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.958662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18b99-c51d-402a-8f5c-3e1c741b5670 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.959169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c18b99-c51d-402a-8f5c-3e1c741b5670 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.961595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 19/40] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:28 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:28.968676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b3a9-fc7c-417a-9f03-ddc1d1e8e8e5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:28.968983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b3a9-fc7c-417a-9f03-ddc1d1e8e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:28.969238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3b3a9-fc7c-417a-9f03-ddc1d1e8e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:28.999358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-07b3b3a9-fc7c-417a-9f03-ddc1d1e8e8e5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:29.000588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-07b3b3a9-fc7c-417a-9f03-ddc1d1e8e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:29.057412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3889-8284-403b-94ef-d58bcf8ae14b None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:29.058062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3889-8284-403b-94ef-d58bcf8ae14b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:29.058549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3889-8284-403b-94ef-d58bcf8ae14b None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:29.060851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 20/41] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:29.068222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf61a-7c33-483b-ba4a-560c4c93a048 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:29.068599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf61a-7c33-483b-ba4a-560c4c93a048 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:29.068949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf61a-7c33-483b-ba4a-560c4c93a048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:29.097007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fa9cf61a-7c33-483b-ba4a-560c4c93a048 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:29.099119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 22/42] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:29.100800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fa9cf61a-7c33-483b-ba4a-560c4c93a048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:29.120274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 21/43] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:29.134403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3b3a9-fc7c-417a-9f03-ddc1d1e8e8e5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:29.144686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b3b3a9-fc7c-417a-9f03-ddc1d1e8e8e5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:29.150188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3df662-6e65-49df-9e57-6a44b7415f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:29.151199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df662-6e65-49df-9e57-6a44b7415f30 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:29.151662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df662-6e65-49df-9e57-6a44b7415f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:29.152113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3df662-6e65-49df-9e57-6a44b7415f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:29.153127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3df662-6e65-49df-9e57-6a44b7415f30 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:29.154442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-cf3df662-6e65-49df-9e57-6a44b7415f30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:29.154442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:03:29.154442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:03:29.155790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3df662-6e65-49df-9e57-6a44b7415f30 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:29.173469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cf61a-7c33-483b-ba4a-560c4c93a048 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:29.179390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cf61a-7c33-483b-ba4a-560c4c93a048 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:29.191719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add91e79-8adc-49e4-b69d-27aa3d8ff4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:29.193412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91e79-8adc-49e4-b69d-27aa3d8ff4eb admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:29.194815 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91e79-8adc-49e4-b69d-27aa3d8ff4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:29.195633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add91e79-8adc-49e4-b69d-27aa3d8ff4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:29.196646 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91e79-8adc-49e4-b69d-27aa3d8ff4eb admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:29.197037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 23/44] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:03:29 2021] POST /identity/v3/roles => generated 225 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:29.199153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add91e79-8adc-49e4-b69d-27aa3d8ff4eb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:29.217385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 22/45] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:03:29 2021] POST /identity/v3/roles => generated 223 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:29.872509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afd9a-cee9-46b7-8e6b-32bf4a19f136 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:29.873111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afd9a-cee9-46b7-8e6b-32bf4a19f136 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:29.873111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739afd9a-cee9-46b7-8e6b-32bf4a19f136 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:29.874965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 24/46] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:29.882102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7ecb-b810-40da-b0f5-3ff9161d1d58 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:29.882650 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7ecb-b810-40da-b0f5-3ff9161d1d58 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:29.882650 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7ecb-b810-40da-b0f5-3ff9161d1d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:29.904905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-01ef7ecb-b810-40da-b0f5-3ff9161d1d58 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:29.906202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-01ef7ecb-b810-40da-b0f5-3ff9161d1d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:29.916220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 23/47] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:29.941202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739afd9a-cee9-46b7-8e6b-32bf4a19f136 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:29.954662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739afd9a-cee9-46b7-8e6b-32bf4a19f136 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:29.959611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:29.960461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:29.960795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:29.961078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:29.973160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:29.980339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:29.981923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 25/48] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:29.988757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef7ecb-b810-40da-b0f5-3ff9161d1d58 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:29.998408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef7ecb-b810-40da-b0f5-3ff9161d1d58 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:30.003695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:30.004423 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:30.004712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:30.004991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:30.005839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:30.006148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:30.007197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:30.007197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:03:30.007197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:03:30.008136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:30.022973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 24/49] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:30.030320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:30.041692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e0f9-be01-45b6-b11c-a3be8fbb2e97 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:30.046796 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:30.047921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:30.048049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:30.048270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:30.049664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:30.051584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:30.053272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 26/50] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:30 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:30.060331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:30.070952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800e5f-d4b8-42f3-af9d-25881a96fc80 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:30.077812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539f6d8-c61d-43c8-ad8f-785f2d2b3875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:30.078567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539f6d8-c61d-43c8-ad8f-785f2d2b3875 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:30.078916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539f6d8-c61d-43c8-ad8f-785f2d2b3875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:30.079197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539f6d8-c61d-43c8-ad8f-785f2d2b3875 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:30.080457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539f6d8-c61d-43c8-ad8f-785f2d2b3875 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:30.082238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539f6d8-c61d-43c8-ad8f-785f2d2b3875 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:30.083855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 25/51] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:30 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:30.090475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:30.101472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c001d-b4b1-42ac-9a28-39a34feaa5a2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:30.106200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e886c-2650-482a-be17-696a25d2680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:30.106861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e886c-2650-482a-be17-696a25d2680c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:30.107143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e886c-2650-482a-be17-696a25d2680c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:30.107426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e886c-2650-482a-be17-696a25d2680c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:30.108281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e886c-2650-482a-be17-696a25d2680c admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.domain.id=default, user.id=a95f866674d64e91af100063311f9b6a) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:30.108596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e886c-2650-482a-be17-696a25d2680c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:30.110594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e886c-2650-482a-be17-696a25d2680c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:30.117026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 27/52] 10.222.0.31 () {56 vars in 1343 bytes} [Tue Nov 16 03:03:30 2021] GET /identity/v3/role_assignments?user.id=a95f866674d64e91af100063311f9b6a&scope.domain.id=default&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:31.468611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954356-3db9-415c-a22c-165879ba2519 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:31.469233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954356-3db9-415c-a22c-165879ba2519 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:31.469233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954356-3db9-415c-a22c-165879ba2519 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:31.471076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 26/53] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:31.477150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92466140-0a10-446a-b82f-30b8ec5af2eb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:31.477640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92466140-0a10-446a-b82f-30b8ec5af2eb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:31.477742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92466140-0a10-446a-b82f-30b8ec5af2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:31.497303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-92466140-0a10-446a-b82f-30b8ec5af2eb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:31.498576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-92466140-0a10-446a-b82f-30b8ec5af2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:31.506749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 28/54] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:31.530579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954356-3db9-415c-a22c-165879ba2519 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:31.543979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954356-3db9-415c-a22c-165879ba2519 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:31.548430 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca40e1-7b22-4add-a85c-e305f434e16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:31.549236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca40e1-7b22-4add-a85c-e305f434e16a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:31.549560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca40e1-7b22-4add-a85c-e305f434e16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:31.549847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca40e1-7b22-4add-a85c-e305f434e16a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:31.551156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca40e1-7b22-4add-a85c-e305f434e16a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:31.552893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca40e1-7b22-4add-a85c-e305f434e16a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:31.554559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 27/55] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:31.560886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92466140-0a10-446a-b82f-30b8ec5af2eb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:31.570801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92466140-0a10-446a-b82f-30b8ec5af2eb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:31.576594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6676b-3966-498e-bcd1-dacd65cc29f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:31.577366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6676b-3966-498e-bcd1-dacd65cc29f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:31.577690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6676b-3966-498e-bcd1-dacd65cc29f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:31.577988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6676b-3966-498e-bcd1-dacd65cc29f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:31.578851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6676b-3966-498e-bcd1-dacd65cc29f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:31.583070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6676b-3966-498e-bcd1-dacd65cc29f6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:31.607861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 29/56] 10.222.0.31 () {60 vars in 1161 bytes} [Tue Nov 16 03:03:31 2021] POST /identity/v3/projects => generated 298 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:34.007175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a678b0c-c253-4a95-952f-396be495e471 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:34.007789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a678b0c-c253-4a95-952f-396be495e471 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:34.007789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a678b0c-c253-4a95-952f-396be495e471 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:34.009536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 28/57] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:34.016104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cd42-d9ca-495c-8bc0-1368d5f65a41 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:34.016712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cd42-d9ca-495c-8bc0-1368d5f65a41 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:34.017366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3cd42-d9ca-495c-8bc0-1368d5f65a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:34.037421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-90d3cd42-d9ca-495c-8bc0-1368d5f65a41 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:34.038671 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-90d3cd42-d9ca-495c-8bc0-1368d5f65a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:34.099171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 30/58] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:34.125063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a678b0c-c253-4a95-952f-396be495e471 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:34.138615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a678b0c-c253-4a95-952f-396be495e471 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:34.143817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd31cdd-d6f0-48cb-85a2-f24b2c157792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:34.144681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31cdd-d6f0-48cb-85a2-f24b2c157792 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:34.145026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31cdd-d6f0-48cb-85a2-f24b2c157792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:34.145348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd31cdd-d6f0-48cb-85a2-f24b2c157792 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:34.146760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd31cdd-d6f0-48cb-85a2-f24b2c157792 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:34.148568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd31cdd-d6f0-48cb-85a2-f24b2c157792 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:34.150364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 29/59] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:34.156792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3cd42-d9ca-495c-8bc0-1368d5f65a41 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:34.166969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3cd42-d9ca-495c-8bc0-1368d5f65a41 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:34.172722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3e262-4fc5-499b-8d6e-5584bacd1fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:34.173408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3e262-4fc5-499b-8d6e-5584bacd1fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:34.173722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3e262-4fc5-499b-8d6e-5584bacd1fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:34.173992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3e262-4fc5-499b-8d6e-5584bacd1fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:34.174747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3e262-4fc5-499b-8d6e-5584bacd1fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:34.175778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-ebf3e262-4fc5-499b-8d6e-5584bacd1fb5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:34.175778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:03:34.175778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:03:34.177071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf3e262-4fc5-499b-8d6e-5584bacd1fb5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:34.204488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 31/60] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:03:34 2021] POST /identity/v3/users => generated 275 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:38.316830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477f38-5d27-4653-bfae-59c089479138 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.317389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477f38-5d27-4653-bfae-59c089479138 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.317827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7477f38-5d27-4653-bfae-59c089479138 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.321664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 30/61] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:38 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:38.331327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0972d-9228-4f49-b3c9-44ee3003ea7c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.332298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0972d-9228-4f49-b3c9-44ee3003ea7c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.332770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0972d-9228-4f49-b3c9-44ee3003ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.358535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6ca0972d-9228-4f49-b3c9-44ee3003ea7c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:38.360188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6ca0972d-9228-4f49-b3c9-44ee3003ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:38.373829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 32/62] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:38.442333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477f38-5d27-4653-bfae-59c089479138 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:38.470190 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7477f38-5d27-4653-bfae-59c089479138 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:38.480934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:38.482345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.482859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.483340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.508419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:38.527348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:03:38.530822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 31/63] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:03:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:38.537449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0972d-9228-4f49-b3c9-44ee3003ea7c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:38.564149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0972d-9228-4f49-b3c9-44ee3003ea7c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:38.575310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:38.575916 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.576203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.576480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.577281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:38.577618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:38.579373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:38.600095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 33/64] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:03:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:38.606983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:38.634125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a5b67-ae74-45a7-9678-4b6e652106a8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:38.648717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:38.650229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.650720 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.651205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.694799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:38.698535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:38.701878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 32/65] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:38 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:38.707850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:38.727534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75136cb0-f184-4e4e-8edb-052079aaf9f0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:38.743375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:38.744059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.744347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.744624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.760400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:38.762277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:38.779996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 34/66] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:03:38.787652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:38.810064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc8f80-a549-4404-a28a-707b0a067d96 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:38.826791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40680703-0325-4eca-bdcd-42e42f9317df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:38.829559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40680703-0325-4eca-bdcd-42e42f9317df admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.831400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40680703-0325-4eca-bdcd-42e42f9317df admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.832142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40680703-0325-4eca-bdcd-42e42f9317df admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.834908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40680703-0325-4eca-bdcd-42e42f9317df admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:38.843606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40680703-0325-4eca-bdcd-42e42f9317df admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:38.847771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 33/67] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:38 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:38.854919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:38.871899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564196c-c2ad-4948-b9ae-b57ab9b39360 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:38.887135 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4ea8d-e9a4-4597-bc91-a93b4e707fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:38.887826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ea8d-e9a4-4597-bc91-a93b4e707fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.888107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ea8d-e9a4-4597-bc91-a93b4e707fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.888397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4ea8d-e9a4-4597-bc91-a93b4e707fcb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.889283 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4ea8d-e9a4-4597-bc91-a93b4e707fcb admin admin] RBAC: Adding query filter params (role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887, user.id=f4f214a399b74701a03f29ff4afa0fe5) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:38.889624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4ea8d-e9a4-4597-bc91-a93b4e707fcb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:38.891623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a4ea8d-e9a4-4597-bc91-a93b4e707fcb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:38.902771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 35/68] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:38 2021] GET /identity/v3/role_assignments?user.id=f4f214a399b74701a03f29ff4afa0fe5&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:38.960455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684e84-fe22-40bb-a32d-82d1eb3cba17 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.961475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684e84-fe22-40bb-a32d-82d1eb3cba17 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.962251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684e84-fe22-40bb-a32d-82d1eb3cba17 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:38.966125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 34/69] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:38 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:38.976683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6383f-e02e-4a50-9e26-ea0e4b226c00 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:38.976962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6383f-e02e-4a50-9e26-ea0e4b226c00 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:38.977222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6383f-e02e-4a50-9e26-ea0e4b226c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.002532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a0a6383f-e02e-4a50-9e26-ea0e4b226c00 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:39.003772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a0a6383f-e02e-4a50-9e26-ea0e4b226c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:39.016889 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 36/70] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:39.045754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170564f-7be2-490b-853e-9bdda613eeb9 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.046256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170564f-7be2-490b-853e-9bdda613eeb9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.046756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170564f-7be2-490b-853e-9bdda613eeb9 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.050321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 35/71] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:39 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:39.057236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54841fd-7400-4182-ba9d-4384e5f5f9bb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.057588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54841fd-7400-4182-ba9d-4384e5f5f9bb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.057819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54841fd-7400-4182-ba9d-4384e5f5f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.070232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170564f-7be2-490b-853e-9bdda613eeb9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.091485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a54841fd-7400-4182-ba9d-4384e5f5f9bb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:39.093535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a54841fd-7400-4182-ba9d-4384e5f5f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:39.100103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170564f-7be2-490b-853e-9bdda613eeb9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.115293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88491315-7872-4887-8a67-f85d31ab24cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.116627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88491315-7872-4887-8a67-f85d31ab24cb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.117132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88491315-7872-4887-8a67-f85d31ab24cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.120197 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 37/72] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:39.120420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88491315-7872-4887-8a67-f85d31ab24cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.146939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54841fd-7400-4182-ba9d-4384e5f5f9bb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.166953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88491315-7872-4887-8a67-f85d31ab24cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:39.167893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54841fd-7400-4182-ba9d-4384e5f5f9bb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.175282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a9d28-6121-469f-912d-3c78e07020bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.176940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9d28-6121-469f-912d-3c78e07020bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.177678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9d28-6121-469f-912d-3c78e07020bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.178418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a9d28-6121-469f-912d-3c78e07020bb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.180010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-88491315-7872-4887-8a67-f85d31ab24cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:39.182372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 36/73] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:39.190576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc594-09c4-4da5-8ab4-ecaa23d1ad9c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.192579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc594-09c4-4da5-8ab4-ecaa23d1ad9c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.193052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55dc594-09c4-4da5-8ab4-ecaa23d1ad9c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.196480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 37/74] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:39 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:39.201800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc594-09c4-4da5-8ab4-ecaa23d1ad9c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.207115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a9d28-6121-469f-912d-3c78e07020bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:39.218530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6c5a9d28-6121-469f-912d-3c78e07020bb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:39.221540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 38/75] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:39.223967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932def-ef5d-4e76-8c5c-8add12b50839 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.224765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932def-ef5d-4e76-8c5c-8add12b50839 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.225512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932def-ef5d-4e76-8c5c-8add12b50839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.230920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55dc594-09c4-4da5-8ab4-ecaa23d1ad9c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.236268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.236950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.237277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.237600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.238399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:39.238745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.240470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.251481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 38/76] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.257458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.268652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c2932def-ef5d-4e76-8c5c-8add12b50839 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:39.271361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c2932def-ef5d-4e76-8c5c-8add12b50839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:39.272155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4e0d1-6c81-447c-ab01-cafabc3f4f31 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.277097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.278077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.278455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.278867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.279849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:39.282109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.284041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.288581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 39/77] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:39.290247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932def-ef5d-4e76-8c5c-8add12b50839 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.295361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 39/78] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.302083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.311249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932def-ef5d-4e76-8c5c-8add12b50839 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.313197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a96a9f-32b5-4e54-9f3b-c04f58724848 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.318575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.319621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.320205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.320749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.321156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.322592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.322776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.323430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.324090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.325540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.326475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.327784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 40/79] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.330364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.333970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 40/80] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.334834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.346662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fd663-3f26-435e-9d70-eafe2f83abdf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.347414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.354440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.356927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.357413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.358598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.369469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.371710 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.373039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31efa70-8519-43e8-9517-9c46e2a9b2ad admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.382259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.383370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.384067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.384747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 41/81] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:39.384941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.385804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.406559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.408417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430e8ce-69d7-4c03-9cb1-6c61f1793468 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.408990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.417970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.419511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.420059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.420609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.421323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 41/82] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:03:39.422794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.439059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a11f-d5f7-41f7-8f5b-2f1e75115fbb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.444911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.446036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.446557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.447028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] PATH_INFO: `/v3/projects/91c341a2a38b4d9e843a2ec27ec136af` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.448498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] RBAC: Authorizing `identity:get_project(project_id=91c341a2a38b4d9e843a2ec27ec136af)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.449620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:39.451028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.453203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 42/83] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/projects/91c341a2a38b4d9e843a2ec27ec136af => generated 312 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.458541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.464205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:39.468265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 42/84] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:39.470215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.479681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54711f1-36db-421a-8292-fb79ac147e6a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.484471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.485703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.486189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.486666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.488102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.488842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595c40-b533-4233-aca0-584d8bd813ec admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.490829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.493446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 43/85] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.499457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.506213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.507189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.507679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.508200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.509296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=91c341a2a38b4d9e843a2ec27ec136af, user.id=f4f214a399b74701a03f29ff4afa0fe5) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:39.509900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.511150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:39.511150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:03:39.511150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:03:39.512711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.519052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866437-b96e-471b-a709-a1c133873b70 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.521778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 43/86] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/role_assignments?user.id=f4f214a399b74701a03f29ff4afa0fe5&scope.project.id=91c341a2a38b4d9e843a2ec27ec136af&role.id=b47636c54d4f488b8ee95139571f50ca => generated 259 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.526518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.541998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.543738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.544549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.545279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.547040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:39.547877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.551333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.563824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b626672-2fed-46e2-8828-6fb1899961c3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.595717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.597260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.597827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 44/87] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.598750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.599285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.599700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.601533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887, user.id=a95f866674d64e91af100063311f9b6a) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:39.602345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.606185 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.617789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 44/88] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/role_assignments?user.id=a95f866674d64e91af100063311f9b6a&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.625288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45032af-0a3f-4ccd-a6b9-4a80efca8883 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.633300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.635316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.636064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.636849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.639506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.644031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.647541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 45/89] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:39.667753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.691906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25602a0a-86c7-4c21-95db-9547531375ed admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.703561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.705191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.706034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.706747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.733188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.737469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.758857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 45/90] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:39.765679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.777144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1634fc-8380-443c-80ab-6a2f583b6774 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.787745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e6ac9-d48d-4429-b73f-7c0c32a13d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.789025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6ac9-d48d-4429-b73f-7c0c32a13d44 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.789618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6ac9-d48d-4429-b73f-7c0c32a13d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.790068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e6ac9-d48d-4429-b73f-7c0c32a13d44 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.792764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e6ac9-d48d-4429-b73f-7c0c32a13d44 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.795656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e6ac9-d48d-4429-b73f-7c0c32a13d44 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.798170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 46/91] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:39.809847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:39.831528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25bd2d-7a21-45fa-ad31-9514fc9bd259 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:39.852080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0deccd5-5769-4d31-948a-c0d5430cc528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:39.853239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deccd5-5769-4d31-948a-c0d5430cc528 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.853758 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deccd5-5769-4d31-948a-c0d5430cc528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.854258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0deccd5-5769-4d31-948a-c0d5430cc528 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.856030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deccd5-5769-4d31-948a-c0d5430cc528 admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887, user.id=f4f214a399b74701a03f29ff4afa0fe5) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:39.856591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deccd5-5769-4d31-948a-c0d5430cc528 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:39.860677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0deccd5-5769-4d31-948a-c0d5430cc528 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:39.878269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 46/92] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:39 2021] GET /identity/v3/role_assignments?user.id=f4f214a399b74701a03f29ff4afa0fe5&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=b47636c54d4f488b8ee95139571f50ca => generated 259 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:39.897783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538b92-a42c-4bf0-bd9c-fade342f695d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.898466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538b92-a42c-4bf0-bd9c-fade342f695d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.898950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538b92-a42c-4bf0-bd9c-fade342f695d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.901385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 47/93] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:39 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:39.924764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b23024-6fbc-4358-9108-de4cf8560e14 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:39.925260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b23024-6fbc-4358-9108-de4cf8560e14 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:39.925781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b23024-6fbc-4358-9108-de4cf8560e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:39.965296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a1b23024-6fbc-4358-9108-de4cf8560e14 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:39.967026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a1b23024-6fbc-4358-9108-de4cf8560e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:39.978511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 47/94] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:40.048130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538b92-a42c-4bf0-bd9c-fade342f695d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:40.067500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538b92-a42c-4bf0-bd9c-fade342f695d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:40.072882 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e52f6b-7ce0-462d-bfca-f70d9ac93f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:40.074129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52f6b-7ce0-462d-bfca-f70d9ac93f1c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:40.074605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52f6b-7ce0-462d-bfca-f70d9ac93f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:40.075159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e52f6b-7ce0-462d-bfca-f70d9ac93f1c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:40.077789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e52f6b-7ce0-462d-bfca-f70d9ac93f1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:40.080309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e52f6b-7ce0-462d-bfca-f70d9ac93f1c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:40.082464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 48/95] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:40.092061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b23024-6fbc-4358-9108-de4cf8560e14 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:40.103056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b23024-6fbc-4358-9108-de4cf8560e14 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:40.114227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663665d5-0df9-447e-97ac-155e3e153566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:40.115417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663665d5-0df9-447e-97ac-155e3e153566 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:40.115914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663665d5-0df9-447e-97ac-155e3e153566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:40.116458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663665d5-0df9-447e-97ac-155e3e153566 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:40.117454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663665d5-0df9-447e-97ac-155e3e153566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:40.118775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-663665d5-0df9-447e-97ac-155e3e153566 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:40.118775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:03:40.118775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:03:40.120457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663665d5-0df9-447e-97ac-155e3e153566 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:40.172911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 48/96] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:03:40 2021] POST /identity/v3/projects => generated 302 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:42.212424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528b76-70c7-4395-9c85-e833cb131e78 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:42.212919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528b76-70c7-4395-9c85-e833cb131e78 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:42.213331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d528b76-70c7-4395-9c85-e833cb131e78 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:42.217228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 49/97] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:42 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:42.229055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e64d13-46c5-4a8a-8053-ad3942af4d2d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:42.229627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e64d13-46c5-4a8a-8053-ad3942af4d2d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:42.230098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e64d13-46c5-4a8a-8053-ad3942af4d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:42.274105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-64e64d13-46c5-4a8a-8053-ad3942af4d2d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:42.276157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-64e64d13-46c5-4a8a-8053-ad3942af4d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:42.369765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 49/98] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:42.408619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528b76-70c7-4395-9c85-e833cb131e78 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:42.448254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d528b76-70c7-4395-9c85-e833cb131e78 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:42.461584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:42.463065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:42.463523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:42.464028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:42.499031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:42.520980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:03:42.523553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 50/99] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:03:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:42.530820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e64d13-46c5-4a8a-8053-ad3942af4d2d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:42.544143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e64d13-46c5-4a8a-8053-ad3942af4d2d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:42.553229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:42.554308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:42.554785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:42.555246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:42.556257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:42.556750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:42.562966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:42.585983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 50/100] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:03:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:42.596284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:42.623015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2636747-79df-4684-9e89-d9a08c4588cc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:42.639400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:42.640952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:42.641471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:42.641982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:42.646772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:42.651006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:42.654362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 51/101] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:42 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:42.661597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:42.677466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf918e-7f77-4196-a638-47e5f96067bb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:42.694673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c277c42-826b-4a88-950e-92a0f1aef8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:42.696195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277c42-826b-4a88-950e-92a0f1aef8ce admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:42.696676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277c42-826b-4a88-950e-92a0f1aef8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:42.697155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c277c42-826b-4a88-950e-92a0f1aef8ce admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:42.699434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c277c42-826b-4a88-950e-92a0f1aef8ce admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:42.703470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c277c42-826b-4a88-950e-92a0f1aef8ce admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:42.706966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 51/102] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:42 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:42.714453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:42.739179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71d388-216a-4600-b7c6-fe16442613d0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:42.755964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f1f41-f8d8-4cfa-b7d3-ea474a1a0680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:42.757593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1f41-f8d8-4cfa-b7d3-ea474a1a0680 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:42.758090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1f41-f8d8-4cfa-b7d3-ea474a1a0680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:42.758589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f1f41-f8d8-4cfa-b7d3-ea474a1a0680 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/users/f4f214a399b74701a03f29ff4afa0fe5/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:42.764467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f1f41-f8d8-4cfa-b7d3-ea474a1a0680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d576dc1e4402ab7e6d6363dda4887, user_id=f4f214a399b74701a03f29ff4afa0fe5, role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:42.767240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-791f1f41-f8d8-4cfa-b7d3-ea474a1a0680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:42.767240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:03:42.767240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:03:42.771292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f1f41-f8d8-4cfa-b7d3-ea474a1a0680 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:42.835301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 52/103] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:03:42 2021] PUT /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/users/f4f214a399b74701a03f29ff4afa0fe5/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:03:43.710983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca36c3-5a5b-445c-b256-e77cff02e035 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:43.711516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca36c3-5a5b-445c-b256-e77cff02e035 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:43.711946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca36c3-5a5b-445c-b256-e77cff02e035 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:43.715343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 52/104] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:43.726411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef17f3-8007-4cef-bddf-3f928f60f348 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:43.726972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef17f3-8007-4cef-bddf-3f928f60f348 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:43.727370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef17f3-8007-4cef-bddf-3f928f60f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:43.775216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bcef17f3-8007-4cef-bddf-3f928f60f348 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:43.777275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bcef17f3-8007-4cef-bddf-3f928f60f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:43.883800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 53/105] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:43.926302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20ec5-e1e8-46c2-80a8-68b2bac38d70 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:43.926802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20ec5-e1e8-46c2-80a8-68b2bac38d70 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:43.927300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e20ec5-e1e8-46c2-80a8-68b2bac38d70 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:43.935081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 53/106] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:43 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:43.951818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466274f-ec91-4b36-903f-dc0da4c8bb65 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:43.952155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466274f-ec91-4b36-903f-dc0da4c8bb65 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:43.952391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466274f-ec91-4b36-903f-dc0da4c8bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:43.956023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20ec5-e1e8-46c2-80a8-68b2bac38d70 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:43.971666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9466274f-ec91-4b36-903f-dc0da4c8bb65 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:43.972882 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9466274f-ec91-4b36-903f-dc0da4c8bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:43.981287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 54/107] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:43.981810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e20ec5-e1e8-46c2-80a8-68b2bac38d70 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:43.997458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:43.998682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:43.999156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:43.999698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.013948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:44.021022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466274f-ec91-4b36-903f-dc0da4c8bb65 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.032822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:44.033180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466274f-ec91-4b36-903f-dc0da4c8bb65 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.038497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 54/108] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:44.046982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631c153-9064-43e8-b502-73e748c86412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.047263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.048500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c153-9064-43e8-b502-73e748c86412 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.048991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c153-9064-43e8-b502-73e748c86412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.049619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631c153-9064-43e8-b502-73e748c86412 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.064300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91a357-bce3-4f3e-b7ae-04d549c458b8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.071978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.073051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.073553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.074003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.075567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:44.076062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.079028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631c153-9064-43e8-b502-73e748c86412 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:44.079201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.093894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 55/109] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:44.098968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6631c153-9064-43e8-b502-73e748c86412 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:44.100278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 55/110] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:44.113410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.125037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e901fe-48fe-4e23-9114-06ce312e723c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.125482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e901fe-48fe-4e23-9114-06ce312e723c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.129455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e901fe-48fe-4e23-9114-06ce312e723c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.129455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 56/111] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:44.137453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e901fe-48fe-4e23-9114-06ce312e723c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.144959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b105-bac9-4a3f-bf34-1b8038aea758 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.161459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b151d4f-a455-407a-a69e-8480f7401326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.161459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b151d4f-a455-407a-a69e-8480f7401326 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.161459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b151d4f-a455-407a-a69e-8480f7401326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.161459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b151d4f-a455-407a-a69e-8480f7401326 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.165448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e901fe-48fe-4e23-9114-06ce312e723c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.165597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b151d4f-a455-407a-a69e-8480f7401326 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:44.165597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b151d4f-a455-407a-a69e-8480f7401326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.169454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b151d4f-a455-407a-a69e-8480f7401326 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.177447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.177447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.177447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.177447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.185448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.185448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.189462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 56/112] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.193447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ce71-8ced-40c1-b75f-83e5e45e16d3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.193601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 57/113] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.193732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ce71-8ced-40c1-b75f-83e5e45e16d3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.193732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956ce71-8ced-40c1-b75f-83e5e45e16d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.213453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8956ce71-8ced-40c1-b75f-83e5e45e16d3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:44.213453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8956ce71-8ced-40c1-b75f-83e5e45e16d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:44.225536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.229455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 57/114] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:44.233447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ce71-8ced-40c1-b75f-83e5e45e16d3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.261453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835569c-6724-4330-97bc-9de9588a7be5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.261792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956ce71-8ced-40c1-b75f-83e5e45e16d3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.269452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.269452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.269452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.269452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.270175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.277457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.277738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.281457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.281457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.281457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.282365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 58/115] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.282683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.285448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.289455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.293448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 58/116] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.293448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.299599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbb596-a508-47ce-89ae-70ec96cfa6ef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.313462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3d13e-fc65-4fa4-99e1-523d5a941b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.313462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d13e-fc65-4fa4-99e1-523d5a941b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.317449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d13e-fc65-4fa4-99e1-523d5a941b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.317449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3d13e-fc65-4fa4-99e1-523d5a941b88 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.317791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05ce0a-de86-4098-8621-9749c01c9c6f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.325462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.329452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.329452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.329452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.329452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.337460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.337770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3d13e-fc65-4fa4-99e1-523d5a941b88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:44.337926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 59/117] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.345456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-26e3d13e-fc65-4fa4-99e1-523d5a941b88 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:44.345456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 59/118] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:44.349453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.351909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8ea3-b8bf-4aad-9165-0f9d635f330e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.352345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8ea3-b8bf-4aad-9165-0f9d635f330e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.352790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a8ea3-b8bf-4aad-9165-0f9d635f330e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.356294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 60/119] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:44 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:44.357799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8ea3-b8bf-4aad-9165-0f9d635f330e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.364574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e6f6a-ce4b-4e16-85c6-03a824cabad2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.369909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.371750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.372242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.372705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/users/a95f866674d64e91af100063311f9b6a/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.375424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d576dc1e4402ab7e6d6363dda4887, user_id=a95f866674d64e91af100063311f9b6a, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.378147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a8ea3-b8bf-4aad-9165-0f9d635f330e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.379339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.385951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e48a65-8a54-4264-9a16-5f36eb50d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.387232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e48a65-8a54-4264-9a16-5f36eb50d9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.387742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e48a65-8a54-4264-9a16-5f36eb50d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.388247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e48a65-8a54-4264-9a16-5f36eb50d9c1 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/users/f4f214a399b74701a03f29ff4afa0fe5/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.393166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e48a65-8a54-4264-9a16-5f36eb50d9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d576dc1e4402ab7e6d6363dda4887, user_id=f4f214a399b74701a03f29ff4afa0fe5, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.398961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e48a65-8a54-4264-9a16-5f36eb50d9c1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.403596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 60/120] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:03:44 2021] PUT /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/users/a95f866674d64e91af100063311f9b6a/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:03:44.404769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.469633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 61/121] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:03:44 2021] PUT /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/users/f4f214a399b74701a03f29ff4afa0fe5/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:03:44.472095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fc4e-bf88-4a3c-8b76-f0f15f03d0bf None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.479172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fc4e-bf88-4a3c-8b76-f0f15f03d0bf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.479645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fc4e-bf88-4a3c-8b76-f0f15f03d0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.493847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99249a-5904-4f40-883d-c46be81bac56 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.547292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9ba1fc4e-bf88-4a3c-8b76-f0f15f03d0bf None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:44.549134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9ba1fc4e-bf88-4a3c-8b76-f0f15f03d0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:44.563782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.564948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.565523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.565996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.567042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:44.567572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.569835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.581275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 61/122] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.585782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 62/123] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:44.589395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fc4e-bf88-4a3c-8b76-f0f15f03d0bf None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.605496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fc4e-bf88-4a3c-8b76-f0f15f03d0bf None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.610843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.612095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.612594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.613056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.623465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.628839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.640654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48af8c-5820-49df-9154-431264cabbc0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.642484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.650762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 63/124] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.655130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.656341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.656958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.657452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.659089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.661504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.666424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.673556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 62/125] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.681019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da70d44-ce76-4093-ab46-470a74dfe19f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.682620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.703816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.703816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.703816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.703816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] PATH_INFO: `/v3/projects/91c341a2a38b4d9e843a2ec27ec136af` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.709470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] RBAC: Authorizing `identity:get_project(project_id=91c341a2a38b4d9e843a2ec27ec136af)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.711608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be39a2-e54b-48a9-9f96-d1b40037ded3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.719862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.730054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 64/126] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:44 2021] GET /identity/v3/projects/91c341a2a38b4d9e843a2ec27ec136af => generated 312 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:44.735606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a6cf5-27e1-4968-98ad-8c5f3a2cf18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.739103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:44.742001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a6cf5-27e1-4968-98ad-8c5f3a2cf18a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.742500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a6cf5-27e1-4968-98ad-8c5f3a2cf18a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.742958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a6cf5-27e1-4968-98ad-8c5f3a2cf18a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.744261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a6cf5-27e1-4968-98ad-8c5f3a2cf18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.746143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-2c0a6cf5-27e1-4968-98ad-8c5f3a2cf18a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:03:44.746143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:03:44.746143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:03:44.748377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a6cf5-27e1-4968-98ad-8c5f3a2cf18a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.783953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d2697-f126-4c7a-acef-4512ee415c4e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:44.806156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162ece0-15b3-4a6c-a193-8b9efe83e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:44.808400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ece0-15b3-4a6c-a193-8b9efe83e139 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:44.808400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ece0-15b3-4a6c-a193-8b9efe83e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:44.808400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162ece0-15b3-4a6c-a193-8b9efe83e139 admin admin] PATH_INFO: `/v3/projects/91c341a2a38b4d9e843a2ec27ec136af/users/f4f214a399b74701a03f29ff4afa0fe5/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:44.812151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ece0-15b3-4a6c-a193-8b9efe83e139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c341a2a38b4d9e843a2ec27ec136af, user_id=f4f214a399b74701a03f29ff4afa0fe5, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:44.817091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162ece0-15b3-4a6c-a193-8b9efe83e139 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:44.832039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 63/127] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:03:44 2021] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:44.856163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 65/128] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:03:44 2021] PUT /identity/v3/projects/91c341a2a38b4d9e843a2ec27ec136af/users/f4f214a399b74701a03f29ff4afa0fe5/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:03:46.092020 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b98e-0786-4110-8ca2-c5f45144f290 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.093024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b98e-0786-4110-8ca2-c5f45144f290 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.093542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1b98e-0786-4110-8ca2-c5f45144f290 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.096001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 64/129] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:46.102876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97554b-3eb3-4c3a-a77b-8af0a7a29989 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.103851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97554b-3eb3-4c3a-a77b-8af0a7a29989 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.104324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97554b-3eb3-4c3a-a77b-8af0a7a29989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.125816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3e97554b-3eb3-4c3a-a77b-8af0a7a29989 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:46.127046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3e97554b-3eb3-4c3a-a77b-8af0a7a29989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:46.259008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 66/130] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:46.306085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b98e-0786-4110-8ca2-c5f45144f290 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:46.327897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1b98e-0786-4110-8ca2-c5f45144f290 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:46.336288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:46.337731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.338196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.338684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.360858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:46.374623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:03:46.376933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 65/131] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:03:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:46.388680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97554b-3eb3-4c3a-a77b-8af0a7a29989 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:46.407753 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97554b-3eb3-4c3a-a77b-8af0a7a29989 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:46.415776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:46.416967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.417534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.418033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.419346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:46.419844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:46.422817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:46.439440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 67/132] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:03:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:46.449635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:46.468764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0189e60-7fd8-4088-ad66-887acf875f39 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:46.476576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:46.478181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.478765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.479261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.481722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:46.486689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:46.489993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 66/133] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:46 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:46.500659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:46.519241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a8c6-eb3d-4b0e-be12-6e41ee794bab admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:46.527676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:46.528986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.529568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.530073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.548235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:46.551790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:46.571323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 68/134] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:46 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:46.582985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:46.602114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d893f7-9893-4a95-a61f-c83ddd1d2a7d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:46.610037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cde518-e05f-4662-b454-939f6e70c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:46.611598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cde518-e05f-4662-b454-939f6e70c884 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.611979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cde518-e05f-4662-b454-939f6e70c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.612408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cde518-e05f-4662-b454-939f6e70c884 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.614942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cde518-e05f-4662-b454-939f6e70c884 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:46.619154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cde518-e05f-4662-b454-939f6e70c884 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:46.622837 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 67/135] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:46 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:46.634362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:46.652580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7711b-e3e1-4f2d-adc4-cdeec6e0bbcc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:46.660819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470bb9f4-cac6-41b9-8aee-8bec973edeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:46.662392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bb9f4-cac6-41b9-8aee-8bec973edeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:46.662902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bb9f4-cac6-41b9-8aee-8bec973edeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:46.663408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bb9f4-cac6-41b9-8aee-8bec973edeb7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:46.665143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bb9f4-cac6-41b9-8aee-8bec973edeb7 admin admin] RBAC: Adding query filter params (role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887, user.id=f4f214a399b74701a03f29ff4afa0fe5) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:46.665788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bb9f4-cac6-41b9-8aee-8bec973edeb7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:46.669774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470bb9f4-cac6-41b9-8aee-8bec973edeb7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:46.682449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 69/136] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:46 2021] GET /identity/v3/role_assignments?user.id=f4f214a399b74701a03f29ff4afa0fe5&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:49.045208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b2678-f630-416b-bf53-c2df3ce50aad None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.045759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b2678-f630-416b-bf53-c2df3ce50aad None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.046192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b2678-f630-416b-bf53-c2df3ce50aad None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.049594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 68/137] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:49.057411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f838-5599-4ec1-81be-45e394e72edd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.057935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f838-5599-4ec1-81be-45e394e72edd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.058441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f838-5599-4ec1-81be-45e394e72edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.093964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-dd24f838-5599-4ec1-81be-45e394e72edd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:49.095974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dd24f838-5599-4ec1-81be-45e394e72edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:49.117205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 70/138] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:49.155071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b2678-f630-416b-bf53-c2df3ce50aad None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:49.186604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b2678-f630-416b-bf53-c2df3ce50aad None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:49.194273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:49.195581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.196024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.196496 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.215521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:49.229256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:49.231617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 69/139] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:49.243239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f838-5599-4ec1-81be-45e394e72edd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:49.260591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f838-5599-4ec1-81be-45e394e72edd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:49.268024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:49.269201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.269734 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.270228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.271682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:49.272240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:49.275464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:49.292457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 71/140] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:49.303971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:49.321833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5596bf-35a2-4ede-a5b2-fccb549280e9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:49.329639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:49.331191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.331696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.332202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.334445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:49.338034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:49.341193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 70/141] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:49 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:49.352104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:49.369774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653f333-5fbc-4ed7-864e-7f320769050b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:49.377631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:49.378793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.379295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.379797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.396478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:49.400149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:49.418621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 72/142] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:49.429845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:49.447904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a9a59-fd17-4641-a158-57bd6117ad07 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:49.456733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c3b12-acc9-46e9-a90e-8a54af8ae380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:49.458742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3b12-acc9-46e9-a90e-8a54af8ae380 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.459504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3b12-acc9-46e9-a90e-8a54af8ae380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.460235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c3b12-acc9-46e9-a90e-8a54af8ae380 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.466772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c3b12-acc9-46e9-a90e-8a54af8ae380 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:49.471471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c3b12-acc9-46e9-a90e-8a54af8ae380 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:49.475111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 71/143] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:49 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:49.486969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:49.510413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91defe21-47a9-4266-97b0-4545395d97f2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:49.526726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149876e4-5714-440c-b628-6fc5d8154e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:49.527932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149876e4-5714-440c-b628-6fc5d8154e9d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.528420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149876e4-5714-440c-b628-6fc5d8154e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.529263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149876e4-5714-440c-b628-6fc5d8154e9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.531077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149876e4-5714-440c-b628-6fc5d8154e9d admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887, user.id=a95f866674d64e91af100063311f9b6a) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:49.531706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149876e4-5714-440c-b628-6fc5d8154e9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:49.535451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149876e4-5714-440c-b628-6fc5d8154e9d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:49.558341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 73/144] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:49 2021] GET /identity/v3/role_assignments?user.id=a95f866674d64e91af100063311f9b6a&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:49.871264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d5d5b-9d32-41f4-8d01-a1202b72e5f6 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.871769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d5d5b-9d32-41f4-8d01-a1202b72e5f6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.872255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d5d5b-9d32-41f4-8d01-a1202b72e5f6 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.875807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 72/145] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:49.884074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60972f-f15e-45cd-b888-b97e5f411dd5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:49.884947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60972f-f15e-45cd-b888-b97e5f411dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:49.885723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60972f-f15e-45cd-b888-b97e5f411dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:49.929793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ce60972f-f15e-45cd-b888-b97e5f411dd5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:49.932346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ce60972f-f15e-45cd-b888-b97e5f411dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:49.959436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 74/146] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:50.035591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d5d5b-9d32-41f4-8d01-a1202b72e5f6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.061422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d5d5b-9d32-41f4-8d01-a1202b72e5f6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.076365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.078405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.079224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.079946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.106945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:50.121295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:50.128104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 73/147] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:50.138720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7424fd-6c9b-4c7a-a666-045fac75b8bb None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.140104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7424fd-6c9b-4c7a-a666-045fac75b8bb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.140865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7424fd-6c9b-4c7a-a666-045fac75b8bb None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.145408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 75/148] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:50 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:03:50.147345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.153774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12fc4-94af-4522-82d6-ded8d1a42857 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.154611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12fc4-94af-4522-82d6-ded8d1a42857 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.155315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd12fc4-94af-4522-82d6-ded8d1a42857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.196783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f54c4-ec75-4ca7-9c47-6e8888594b5f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.216182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.217756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.218468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.219215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.220885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:50.221732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.223688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6fd12fc4-94af-4522-82d6-ded8d1a42857 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:50.227148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.229662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6fd12fc4-94af-4522-82d6-ded8d1a42857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:50.249474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 74/149] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:50.260252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.261646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 76/150] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:50.288653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6542e34-e49b-4e64-94b6-82d6d510f4c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.303023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.305212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.306039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.306470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd12fc4-94af-4522-82d6-ded8d1a42857 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.306801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.315206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.321468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.323372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 75/151] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:50.334180 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.338000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd12fc4-94af-4522-82d6-ded8d1a42857 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.356723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a9358-da36-4129-8706-0fd161a41460 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.367808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.369702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.370415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.370860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.371471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.372168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.372740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.377458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.396562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.400584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.414905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:50.429479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 76/152] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:03:50.435101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:50.435447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.441983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 77/153] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:50.451457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.457385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b49a4-4707-4965-98b7-960303f2761f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.472895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.473816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.474101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.474371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.476183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.478536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.480375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 77/154] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:50.481731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43f6c0-a916-4c7e-8b8c-fd6f58443408 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.491173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.506590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.507677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.508147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.508623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.510112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:50.510652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.513953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.514863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf44b62-6db0-4084-af27-0c08b0dd0f8e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.522139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.522860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.523099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.523373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.524239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887, user.id=f4f214a399b74701a03f29ff4afa0fe5) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:50.524593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.530849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.538493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 78/155] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/role_assignments?user.id=f4f214a399b74701a03f29ff4afa0fe5&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=b47636c54d4f488b8ee95139571f50ca => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:50.541423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 78/156] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:50.547850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.559539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dcfcb-75cf-433a-a433-b5be425edf0a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.570974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.571928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.572380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.572657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.575741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.578412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.580385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 79/157] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:50.587567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.616841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f47c7e-54df-49b0-84a8-0d76b4ea926b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.632822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.633696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.634104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.634511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.660461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.663957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.687397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 79/158] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:50.694244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.707953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac493742-8882-4f50-826f-5b5ee45e385d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.722969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0e613-44ee-4025-a8f7-e45af32f04d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.723889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0e613-44ee-4025-a8f7-e45af32f04d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.724125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0e613-44ee-4025-a8f7-e45af32f04d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.724395 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0e613-44ee-4025-a8f7-e45af32f04d9 admin admin] PATH_INFO: `/v3/projects/91c341a2a38b4d9e843a2ec27ec136af` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.730673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0e613-44ee-4025-a8f7-e45af32f04d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=91c341a2a38b4d9e843a2ec27ec136af)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.732893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0e613-44ee-4025-a8f7-e45af32f04d9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.735260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 80/159] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/projects/91c341a2a38b4d9e843a2ec27ec136af => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:50.742478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.763239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68327ada-3278-4fef-8931-c843ebb0aa14 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.768549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8099b-9f60-4078-a910-e8c83b62fa34 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.768549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8099b-9f60-4078-a910-e8c83b62fa34 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.768549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8099b-9f60-4078-a910-e8c83b62fa34 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.771499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 81/160] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:50.775378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:50.777007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.777820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.778629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.780766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=91c341a2a38b4d9e843a2ec27ec136af, user.id=f4f214a399b74701a03f29ff4afa0fe5) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:50.781820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:50.786550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:50.803122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 80/161] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/role_assignments?user.id=f4f214a399b74701a03f29ff4afa0fe5&scope.project.id=91c341a2a38b4d9e843a2ec27ec136af&role.id=b47636c54d4f488b8ee95139571f50ca => generated 608 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:50.811924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2a06-b6bf-478d-8699-81ef2ddaf88c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:50.811924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2a06-b6bf-478d-8699-81ef2ddaf88c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:50.811924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2a06-b6bf-478d-8699-81ef2ddaf88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:50.852814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2acf2a06-b6bf-478d-8699-81ef2ddaf88c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:50.854192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2acf2a06-b6bf-478d-8699-81ef2ddaf88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:50.869684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 82/162] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:50.957912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:50.982301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d30268a-9587-4b48-b72e-6618aa2297e6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:50.999743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:51.001129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.001594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.002081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.035384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:51.047927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:51.049985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 81/163] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:51.061181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2a06-b6bf-478d-8699-81ef2ddaf88c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:51.074943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2a06-b6bf-478d-8699-81ef2ddaf88c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:51.088061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:51.088758 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.089027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.089304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.090174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:51.090478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:51.092134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:51.106704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 83/164] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:51.117925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:51.143549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5826689a-e054-4e29-8d53-ea8ae40f027c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:51.156192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:51.157970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.158451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.158954 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] PATH_INFO: `/v3/users/5029a5f098df4602a858aca99c122b4e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.191069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] RBAC: Authorizing `identity:get_user(user_id=5029a5f098df4602a858aca99c122b4e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:51.195509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:51.199395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 82/165] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:51 2021] GET /identity/v3/users/5029a5f098df4602a858aca99c122b4e => generated 283 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:51.210879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:51.228627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea444de5-56e6-4d67-a78d-d417e7f175c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:51.235464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:51.236256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.236544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.236815 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.250516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:51.252419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:51.263237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 84/166] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:51.273342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:51.300160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74642a81-194e-4640-9116-33aee2c00ee9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:51.313613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27653a4-659e-4ee3-b29c-9ede0ae17889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:51.315218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27653a4-659e-4ee3-b29c-9ede0ae17889 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.315755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27653a4-659e-4ee3-b29c-9ede0ae17889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.316234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27653a4-659e-4ee3-b29c-9ede0ae17889 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.320385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27653a4-659e-4ee3-b29c-9ede0ae17889 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:51.324485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27653a4-659e-4ee3-b29c-9ede0ae17889 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:51.328095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 83/167] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:51 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:51.341505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:51.357142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f95050-ab8f-4208-a835-d8ce0f237703 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:51.366009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f93042-8f88-4bd3-9327-b6e541c6f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:51.367401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93042-8f88-4bd3-9327-b6e541c6f2df admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.368106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93042-8f88-4bd3-9327-b6e541c6f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.368770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f93042-8f88-4bd3-9327-b6e541c6f2df admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.370441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f93042-8f88-4bd3-9327-b6e541c6f2df admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=1553b5a1fd044efd942a69ded741565d, user.id=5029a5f098df4602a858aca99c122b4e) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:51.371212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f93042-8f88-4bd3-9327-b6e541c6f2df admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:51.374578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f93042-8f88-4bd3-9327-b6e541c6f2df admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:51.387348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 85/168] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:51 2021] GET /identity/v3/role_assignments?user.id=5029a5f098df4602a858aca99c122b4e&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=b47636c54d4f488b8ee95139571f50ca => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:51.871968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b093548-ad66-4919-b2eb-c341f07332c2 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.872456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b093548-ad66-4919-b2eb-c341f07332c2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.872917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b093548-ad66-4919-b2eb-c341f07332c2 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.876489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 84/169] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:51 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:51.887798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb50478-6fc8-434c-ae48-67d0241432dd None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.888853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb50478-6fc8-434c-ae48-67d0241432dd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.889709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb50478-6fc8-434c-ae48-67d0241432dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.922532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-dfb50478-6fc8-434c-ae48-67d0241432dd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:51.925546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-dfb50478-6fc8-434c-ae48-67d0241432dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:51.939954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 86/170] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:51.944586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765049-9c99-4450-93d7-0296cdff5f5e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.944930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765049-9c99-4450-93d7-0296cdff5f5e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.945153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8765049-9c99-4450-93d7-0296cdff5f5e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.947532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 85/171] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:51.955781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db442fc-7e8a-4dec-89c9-8c227df16c2e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.956799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db442fc-7e8a-4dec-89c9-8c227df16c2e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.957628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db442fc-7e8a-4dec-89c9-8c227df16c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.972025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765049-9c99-4450-93d7-0296cdff5f5e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:51.990406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8765049-9c99-4450-93d7-0296cdff5f5e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:51.992361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3db442fc-7e8a-4dec-89c9-8c227df16c2e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:51.996078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:51.997093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:51.997223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:51.997492 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:51.998608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3db442fc-7e8a-4dec-89c9-8c227df16c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:52.011312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:52.020652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:52.020652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 86/172] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:52.022338 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 87/173] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:52.041249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.050119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db442fc-7e8a-4dec-89c9-8c227df16c2e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.057263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a42a10-ddd5-4693-9e6f-bcd6b5df9f3f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.063501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.064439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.064724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.064996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.065950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:52.066255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.068009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.069888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db442fc-7e8a-4dec-89c9-8c227df16c2e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.077964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.080354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 87/174] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:52.081340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.082151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.082885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.087229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.099928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37826f-9078-46be-8c95-86ed0933fb48 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.104340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:52.105192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.106194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.106469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.106760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.108255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.114393 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.115939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 88/175] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:52.123069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:03:52.125866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 88/176] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:52.130692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.138869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.149873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680ecb9-b5bb-4371-8d76-038e4a78d9e8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.153820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09722-d676-4e2e-810c-6fd2541ff5dc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.155519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.156451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.156699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.157138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.158081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:52.158447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.160726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.166943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.168448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.170110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.171318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.173571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 89/177] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:52.182023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.190869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.194053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ace60-0969-443e-b362-aacf981606bc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.195700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.199427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.200542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.200881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.201207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] PATH_INFO: `/v3/users/5029a5f098df4602a858aca99c122b4e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.202974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] RBAC: Authorizing `identity:get_user(user_id=5029a5f098df4602a858aca99c122b4e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.205620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.213119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 90/178] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/users/5029a5f098df4602a858aca99c122b4e => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:52.214519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.218642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 89/179] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:03:52.230913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.235424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ffbb0a-f5df-4c0c-bc65-89d01a9f71b6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.241488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.242231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.242504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.242774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.250858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f862e4-45fd-4eab-a71d-63da1d196fcf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.252778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.254942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.260352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.262605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.264183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.265332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.268099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.268337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 91/180] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:03:52.272999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.274975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.281775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 90/181] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:52.290792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.291951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fcae1e-ddc3-491a-8a13-84825d2b726a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.302000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176a919-2cef-4f12-a2e0-170893072e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.303160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec41d9d-e987-4b1f-b148-8cecb92c2c8b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.304394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176a919-2cef-4f12-a2e0-170893072e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.305302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176a919-2cef-4f12-a2e0-170893072e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.306160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176a919-2cef-4f12-a2e0-170893072e08 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.308880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176a919-2cef-4f12-a2e0-170893072e08 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.309266 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.309987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.310267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.310531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.311425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=1553b5a1fd044efd942a69ded741565d, user.id=a95f866674d64e91af100063311f9b6a) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:52.311731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.313819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.316126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176a919-2cef-4f12-a2e0-170893072e08 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.325504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 91/182] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/role_assignments?user.id=a95f866674d64e91af100063311f9b6a&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:52.326562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 92/183] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:52.327422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.338610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f1bfd-e2f0-427c-b09a-2679d04825d2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.343267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b50ad3-7053-41cc-98f8-88e02760806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.344267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50ad3-7053-41cc-98f8-88e02760806d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.344673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50ad3-7053-41cc-98f8-88e02760806d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.344975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b50ad3-7053-41cc-98f8-88e02760806d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.345962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50ad3-7053-41cc-98f8-88e02760806d admin admin] RBAC: Adding query filter params (role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=1553b5a1fd044efd942a69ded741565d, user.id=5029a5f098df4602a858aca99c122b4e) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:52.346329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50ad3-7053-41cc-98f8-88e02760806d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.348352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b50ad3-7053-41cc-98f8-88e02760806d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.355811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 92/184] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/role_assignments?user.id=5029a5f098df4602a858aca99c122b4e&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:52.618856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0eec8-324e-4be4-a82f-16db47b25f9d None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.619729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0eec8-324e-4be4-a82f-16db47b25f9d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.620461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0eec8-324e-4be4-a82f-16db47b25f9d None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.624054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 93/185] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:52 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:52.633872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc92d-9cbd-426d-ba47-03917472e224 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.634281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc92d-9cbd-426d-ba47-03917472e224 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.634435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc92d-9cbd-426d-ba47-03917472e224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.654054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7a7cc92d-9cbd-426d-ba47-03917472e224 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:52.655259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7a7cc92d-9cbd-426d-ba47-03917472e224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:52.663804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 93/186] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:52 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:52.693106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0eec8-324e-4be4-a82f-16db47b25f9d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.714290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0eec8-324e-4be4-a82f-16db47b25f9d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.721945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2654084-0395-4dc9-9dc5-60f59eafa124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.723387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654084-0395-4dc9-9dc5-60f59eafa124 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.723921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654084-0395-4dc9-9dc5-60f59eafa124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.724386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2654084-0395-4dc9-9dc5-60f59eafa124 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.726650 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2654084-0395-4dc9-9dc5-60f59eafa124 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.729904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2654084-0395-4dc9-9dc5-60f59eafa124 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.733053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 94/187] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:52.739968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cc92d-9cbd-426d-ba47-03917472e224 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:52.749939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cc92d-9cbd-426d-ba47-03917472e224 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:52.755811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c521387-cc5f-4326-a7bd-c17270f005da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:52.756520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c521387-cc5f-4326-a7bd-c17270f005da admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:52.756801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c521387-cc5f-4326-a7bd-c17270f005da admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:52.757459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c521387-cc5f-4326-a7bd-c17270f005da admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:52.758238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c521387-cc5f-4326-a7bd-c17270f005da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:52.760217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c521387-cc5f-4326-a7bd-c17270f005da admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:52.787122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 94/188] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:03:52 2021] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:54.970701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7432-59c6-4ae3-b244-5565f29cb984 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:54.971718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7432-59c6-4ae3-b244-5565f29cb984 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:54.971718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7432-59c6-4ae3-b244-5565f29cb984 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:54.975365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 95/189] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:54 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:54.987187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d8b9-92ab-4635-a9e5-d3ea3f672b1a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:54.988118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d8b9-92ab-4635-a9e5-d3ea3f672b1a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:54.988118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860d8b9-92ab-4635-a9e5-d3ea3f672b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.027148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e860d8b9-92ab-4635-a9e5-d3ea3f672b1a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:55.029554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e860d8b9-92ab-4635-a9e5-d3ea3f672b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:55.049531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 95/190] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:55.099999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c7432-59c6-4ae3-b244-5565f29cb984 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:55.132123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c7432-59c6-4ae3-b244-5565f29cb984 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:55.145617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:55.146944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.147422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.147896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.179127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:55.196710 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:55.205600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 96/191] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:55 2021] GET /identity/v3/roles/member => generated 84 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:55.210074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860d8b9-92ab-4635-a9e5-d3ea3f672b1a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:55.240071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860d8b9-92ab-4635-a9e5-d3ea3f672b1a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:55.266668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:55.268322 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.269100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.269853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.271418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:55.272329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:55.275706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:55.299211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 96/192] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:55.310379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:55.341134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b941f5-c9de-4b86-9b47-94c165ab1567 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:55.356169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:55.357539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.358016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.358500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] PATH_INFO: `/v3/users/5029a5f098df4602a858aca99c122b4e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.367066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=5029a5f098df4602a858aca99c122b4e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:55.371712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:55.374995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 97/193] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:55 2021] GET /identity/v3/users/5029a5f098df4602a858aca99c122b4e => generated 283 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:55.385561 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:55.410975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f2358-26cf-47c5-b126-565f8cfb3bab admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:55.423692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baec463-bfbd-42ec-9f44-1a9848e5614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:55.425931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec463-bfbd-42ec-9f44-1a9848e5614c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.426827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec463-bfbd-42ec-9f44-1a9848e5614c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.427545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baec463-bfbd-42ec-9f44-1a9848e5614c admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.435157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baec463-bfbd-42ec-9f44-1a9848e5614c admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:55.440032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baec463-bfbd-42ec-9f44-1a9848e5614c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:55.444004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 97/194] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:55 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:55.455426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:55.486341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba85c2-fe16-41fe-a130-e4a94c5271b9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:55.503720 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af711-7518-4898-9997-91b30a3f04e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:55.505281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af711-7518-4898-9997-91b30a3f04e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.505801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af711-7518-4898-9997-91b30a3f04e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.506294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af711-7518-4898-9997-91b30a3f04e7 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d/users/5029a5f098df4602a858aca99c122b4e/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.516275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af711-7518-4898-9997-91b30a3f04e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1553b5a1fd044efd942a69ded741565d, user_id=5029a5f098df4602a858aca99c122b4e, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:55.521799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af711-7518-4898-9997-91b30a3f04e7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:55.577787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 98/195] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:03:55 2021] PUT /identity/v3/projects/1553b5a1fd044efd942a69ded741565d/users/5029a5f098df4602a858aca99c122b4e/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:03:55.623690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df8d0-028b-4c03-8a3e-a6029c2304a9 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.624653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df8d0-028b-4c03-8a3e-a6029c2304a9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.625470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032df8d0-028b-4c03-8a3e-a6029c2304a9 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.629679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 98/196] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:55 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:55.637351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81644-ec16-47b6-bc5d-6758212f048b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.637826 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81644-ec16-47b6-bc5d-6758212f048b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.638295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81644-ec16-47b6-bc5d-6758212f048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.683213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b5a81644-ec16-47b6-bc5d-6758212f048b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:55.685867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b5a81644-ec16-47b6-bc5d-6758212f048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:55.817402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 99/197] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:55.853062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df8d0-028b-4c03-8a3e-a6029c2304a9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:55.891017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032df8d0-028b-4c03-8a3e-a6029c2304a9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:55.899181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:55.901016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.901803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.902535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.936404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:55.953621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:03:55.956398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 99/198] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:03:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:55.963763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81644-ec16-47b6-bc5d-6758212f048b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:55.982575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81644-ec16-47b6-bc5d-6758212f048b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:55.991417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:55.992592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:55.993073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:55.993583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:55.995085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:55.995615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:55.998760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.016703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 100/199] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:03:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:56.023531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.047232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935d6a2-0ba0-451d-9626-cbcd37371bf0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.062760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.064268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.064726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.065203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] PATH_INFO: `/v3/users/5029a5f098df4602a858aca99c122b4e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.067721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] RBAC: Authorizing `identity:get_user(user_id=5029a5f098df4602a858aca99c122b4e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.072015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.079655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 100/200] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/users/5029a5f098df4602a858aca99c122b4e => generated 283 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:56.086798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.116295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b10b7c-1f49-4f7c-83aa-a9fb00a8ef1b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.127024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c7401-18a5-49b6-b83d-c74f4bf7cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.127928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7401-18a5-49b6-b83d-c74f4bf7cbab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.128206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7401-18a5-49b6-b83d-c74f4bf7cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.128481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c7401-18a5-49b6-b83d-c74f4bf7cbab admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.131578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c7401-18a5-49b6-b83d-c74f4bf7cbab admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.133847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c7401-18a5-49b6-b83d-c74f4bf7cbab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.135765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 101/201] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:56.143495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.171091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b36af6-4984-44e9-b994-c6f157d29129 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.184062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223210d7-5f74-4ba8-8445-3f73cdc78c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.185677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223210d7-5f74-4ba8-8445-3f73cdc78c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.186158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223210d7-5f74-4ba8-8445-3f73cdc78c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.186636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223210d7-5f74-4ba8-8445-3f73cdc78c03 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d/users/5029a5f098df4602a858aca99c122b4e/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.197053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223210d7-5f74-4ba8-8445-3f73cdc78c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1553b5a1fd044efd942a69ded741565d, user_id=5029a5f098df4602a858aca99c122b4e, role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.202667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223210d7-5f74-4ba8-8445-3f73cdc78c03 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.238519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 101/202] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:03:56 2021] PUT /identity/v3/projects/1553b5a1fd044efd942a69ded741565d/users/5029a5f098df4602a858aca99c122b4e/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:03:56.258633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018007-7f38-4f02-8c23-ffb883a3f093 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.258888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018007-7f38-4f02-8c23-ffb883a3f093 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.259191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef018007-7f38-4f02-8c23-ffb883a3f093 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.261197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 102/203] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:56.278953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b195f-cef6-4551-b0b2-eff0d8eff4c4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.279909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b195f-cef6-4551-b0b2-eff0d8eff4c4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.280659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b195f-cef6-4551-b0b2-eff0d8eff4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.361128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b517-5bf0-43c8-88c8-063580b4fef7 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.361450 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b517-5bf0-43c8-88c8-063580b4fef7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.361727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19b517-5bf0-43c8-88c8-063580b4fef7 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.363946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 103/204] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:56.376444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59678a-4390-42e1-b232-ed4beb7b93e7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.376818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59678a-4390-42e1-b232-ed4beb7b93e7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.377180 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59678a-4390-42e1-b232-ed4beb7b93e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.423499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bf59678a-4390-42e1-b232-ed4beb7b93e7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:56.424736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bf59678a-4390-42e1-b232-ed4beb7b93e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:56.533256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-467b195f-cef6-4551-b0b2-eff0d8eff4c4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:56.535894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-467b195f-cef6-4551-b0b2-eff0d8eff4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:56.595953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 104/205] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:56.622070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59678a-4390-42e1-b232-ed4beb7b93e7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.638927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59678a-4390-42e1-b232-ed4beb7b93e7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.651871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026298a-776c-4093-9811-165a6916041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.653919 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026298a-776c-4093-9811-165a6916041d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.654811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026298a-776c-4093-9811-165a6916041d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.655582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026298a-776c-4093-9811-165a6916041d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.683965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 102/206] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:03:56.685768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026298a-776c-4093-9811-165a6916041d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:56.692123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a026298a-776c-4093-9811-165a6916041d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:03:56.693834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 105/207] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:03:56.700628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b195f-cef6-4551-b0b2-eff0d8eff4c4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.711391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b195f-cef6-4551-b0b2-eff0d8eff4c4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.718600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.719646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.719934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.720221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.721002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:56.721305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.722965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.733141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 103/208] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:56.739070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026298a-776c-4093-9811-165a6916041d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.747165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.755359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026298a-776c-4093-9811-165a6916041d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.761179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9650a6-ba2e-4447-84a2-d97ee3a99fcd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.764799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.766924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.766924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.766924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.771246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.772155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.772425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.772699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.774313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.776155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.777928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 104/209] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:56.784517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.798430 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:56.799762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1b7a4-2f5c-4cc9-abc0-ac901e785a68 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.814138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:56.817158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.818268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.818736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.819129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.822210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 106/210] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:56.823250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.825538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.829897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.832748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 105/211] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:56.839572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.850340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbcdb6-2158-4694-a4f2-5e30066250dc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.855848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4790f4-084a-4e11-bf02-8bfc668f3ce4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:56.861462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679715-a025-4f4c-b78e-ac4c9c09a1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.861462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679715-a025-4f4c-b78e-ac4c9c09a1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.861462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679715-a025-4f4c-b78e-ac4c9c09a1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.861462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679715-a025-4f4c-b78e-ac4c9c09a1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.862792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679715-a025-4f4c-b78e-ac4c9c09a1b8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:56.863937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679715-a025-4f4c-b78e-ac4c9c09a1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.868119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8a149-b173-4acc-9dc3-fcede23f2f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:56.868478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679715-a025-4f4c-b78e-ac4c9c09a1b8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.869263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8a149-b173-4acc-9dc3-fcede23f2f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.869655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8a149-b173-4acc-9dc3-fcede23f2f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.870003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8a149-b173-4acc-9dc3-fcede23f2f11 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d/users/a95f866674d64e91af100063311f9b6a/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.872344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8a149-b173-4acc-9dc3-fcede23f2f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1553b5a1fd044efd942a69ded741565d, user_id=a95f866674d64e91af100063311f9b6a, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:56.875240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8a149-b173-4acc-9dc3-fcede23f2f11 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:56.889529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 107/212] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:56.892120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b35f4-1b47-4aef-b7b2-a5d29a277e66 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.892684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b35f4-1b47-4aef-b7b2-a5d29a277e66 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.893093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b35f4-1b47-4aef-b7b2-a5d29a277e66 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.895465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 108/213] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:56.895876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 106/214] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:03:56 2021] PUT /identity/v3/projects/1553b5a1fd044efd942a69ded741565d/users/a95f866674d64e91af100063311f9b6a/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:03:56.902137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b35f4-1b47-4aef-b7b2-a5d29a277e66 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:56.903452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225ee9e-7608-4a35-9719-71d9d297b3a5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:56.904039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225ee9e-7608-4a35-9719-71d9d297b3a5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:56.904456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225ee9e-7608-4a35-9719-71d9d297b3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:56.947427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1225ee9e-7608-4a35-9719-71d9d297b3a5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:56.952927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1225ee9e-7608-4a35-9719-71d9d297b3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:57.035044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b35f4-1b47-4aef-b7b2-a5d29a277e66 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:57.041198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:57.042327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:57.042687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:57.043040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] PATH_INFO: `/v3/users/e8b145a06507479ca4b566f649839972` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:57.067483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] RBAC: Authorizing `identity:get_user(user_id=e8b145a06507479ca4b566f649839972)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:57.070273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:57.072685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 109/215] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:56 2021] GET /identity/v3/users/e8b145a06507479ca4b566f649839972 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:57.083499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 107/216] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:57.084545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:57.099329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f82cf2-cf33-415c-a568-7298f52e2561 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:57.119401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:57.120104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:57.120393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:57.120695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:57.121670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, user.id=e8b145a06507479ca4b566f649839972, scope.system=all) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:57.121984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:57.123978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:57.141961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 110/217] 10.222.0.31 () {56 vars in 1329 bytes} [Tue Nov 16 03:03:57 2021] GET /identity/v3/role_assignments?user.id=e8b145a06507479ca4b566f649839972&scope.system=all&role.id=b47636c54d4f488b8ee95139571f50ca => generated 226 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:57.144443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225ee9e-7608-4a35-9719-71d9d297b3a5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:57.162682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225ee9e-7608-4a35-9719-71d9d297b3a5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:57.170592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a084e4b-b855-4404-a2a7-0d07cded49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:57.172183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084e4b-b855-4404-a2a7-0d07cded49ae admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:57.172744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084e4b-b855-4404-a2a7-0d07cded49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:57.173331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a084e4b-b855-4404-a2a7-0d07cded49ae admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:57.175896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084e4b-b855-4404-a2a7-0d07cded49ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:57.179583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a084e4b-b855-4404-a2a7-0d07cded49ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:57.183611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 108/218] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:03:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:57.189921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:57.203743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50041c32-33a3-47f0-9c22-e79fab225885 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:57.218111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45efe87-ea23-4fc1-844f-01275edc535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:57.219147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efe87-ea23-4fc1-844f-01275edc535c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:57.219576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efe87-ea23-4fc1-844f-01275edc535c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:57.219993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45efe87-ea23-4fc1-844f-01275edc535c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:57.220916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45efe87-ea23-4fc1-844f-01275edc535c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:57.224938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45efe87-ea23-4fc1-844f-01275edc535c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:57.267094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 111/219] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:03:57 2021] POST /identity/v3/users => generated 293 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:03:59.217713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e547a-d137-4ed4-b979-b348cc1096f8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.218225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e547a-d137-4ed4-b979-b348cc1096f8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.218761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e547a-d137-4ed4-b979-b348cc1096f8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.222411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 109/220] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:03:59 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:03:59.228755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f443ae3-89bf-43c0-838c-5bf22241bf44 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.229219 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f443ae3-89bf-43c0-838c-5bf22241bf44 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.229290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f443ae3-89bf-43c0-838c-5bf22241bf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.257939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0f443ae3-89bf-43c0-838c-5bf22241bf44 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:03:59.259193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0f443ae3-89bf-43c0-838c-5bf22241bf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:03:59.272866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 112/221] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:03:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:03:59.321592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e547a-d137-4ed4-b979-b348cc1096f8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:59.339920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e547a-d137-4ed4-b979-b348cc1096f8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:59.351316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:59.352433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.352798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.353071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.373815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:03:59.381865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:03:59.383233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 110/222] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:03:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:03:59.390877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f443ae3-89bf-43c0-838c-5bf22241bf44 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:59.402726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f443ae3-89bf-43c0-838c-5bf22241bf44 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:59.410679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:59.411728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.412007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.412277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.413175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:59.413501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:59.415258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:59.441836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 113/223] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:03:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:03:59.452496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:59.475406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8c053-d89f-4326-b514-9a94f08463a5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:59.487887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:59.489410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.489883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.490344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] PATH_INFO: `/v3/users/5029a5f098df4602a858aca99c122b4e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.498450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] RBAC: Authorizing `identity:get_user(user_id=5029a5f098df4602a858aca99c122b4e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:59.501054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:59.502873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 111/224] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:03:59 2021] GET /identity/v3/users/5029a5f098df4602a858aca99c122b4e => generated 283 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:59.509865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:59.527319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414769f9-e9f3-41fc-a139-3433d10e7ccd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:59.539356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:59.540451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.540923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.541371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.557526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:59.559353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:59.571468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 114/225] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:03:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:03:59.582371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:59.609952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72e652-005b-4c02-858a-7c98dbe66744 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:59.623485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d5c0c-d071-4b63-a8be-d92e69fe04f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:59.625021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d5c0c-d071-4b63-a8be-d92e69fe04f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.625553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d5c0c-d071-4b63-a8be-d92e69fe04f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.626028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d5c0c-d071-4b63-a8be-d92e69fe04f9 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.630706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d5c0c-d071-4b63-a8be-d92e69fe04f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:59.634767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d5c0c-d071-4b63-a8be-d92e69fe04f9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:59.638023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 112/226] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:03:59 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:03:59.648237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:03:59.663006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37661b0-38f7-4aa7-929f-4b6e613ae073 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:03:59.668246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60df769-af8f-449d-8c74-59d30665d3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:03:59.669281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60df769-af8f-449d-8c74-59d30665d3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:03:59.669808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60df769-af8f-449d-8c74-59d30665d3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:03:59.670305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60df769-af8f-449d-8c74-59d30665d3f8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:03:59.671379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60df769-af8f-449d-8c74-59d30665d3f8 admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=1553b5a1fd044efd942a69ded741565d, user.id=5029a5f098df4602a858aca99c122b4e) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:03:59.672833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60df769-af8f-449d-8c74-59d30665d3f8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:03:59.675323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60df769-af8f-449d-8c74-59d30665d3f8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:03:59.687041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 115/227] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:03:59 2021] GET /identity/v3/role_assignments?user.id=5029a5f098df4602a858aca99c122b4e&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=b47636c54d4f488b8ee95139571f50ca => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:00.342679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961ac5-5776-4628-897d-09a2150eacfa None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.343214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961ac5-5776-4628-897d-09a2150eacfa None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.343214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43961ac5-5776-4628-897d-09a2150eacfa None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.345128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 113/228] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:00.360376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817731-7f1b-410a-8e3b-8ff74f07872e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.360931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817731-7f1b-410a-8e3b-8ff74f07872e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.360931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1817731-7f1b-410a-8e3b-8ff74f07872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.390231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f1817731-7f1b-410a-8e3b-8ff74f07872e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:00.392280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f1817731-7f1b-410a-8e3b-8ff74f07872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:00.405441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 116/229] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:00.442738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c39055-135a-47c5-aaa5-51dd5a0ec87b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.443046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c39055-135a-47c5-aaa5-51dd5a0ec87b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.443283 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c39055-135a-47c5-aaa5-51dd5a0ec87b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.445291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 114/230] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:00.451729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c39055-135a-47c5-aaa5-51dd5a0ec87b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.452267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d14f-f3d2-46e7-b0f4-9b15a7ce87ef None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.452589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d14f-f3d2-46e7-b0f4-9b15a7ce87ef None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.453192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806d14f-f3d2-46e7-b0f4-9b15a7ce87ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.469656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c39055-135a-47c5-aaa5-51dd5a0ec87b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.476677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e806d14f-f3d2-46e7-b0f4-9b15a7ce87ef None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:00.478012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e806d14f-f3d2-46e7-b0f4-9b15a7ce87ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:00.478459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.479274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.479550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.479880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.486948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 117/231] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:00.488354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b3c25-f357-4fb2-92b3-d3e11e6b7f00 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.488640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b3c25-f357-4fb2-92b3-d3e11e6b7f00 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.488910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b3c25-f357-4fb2-92b3-d3e11e6b7f00 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.490881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 118/232] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:00.498112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814efb7f-c433-4384-b725-a076e2cffe98 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.498393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814efb7f-c433-4384-b725-a076e2cffe98 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.498663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814efb7f-c433-4384-b725-a076e2cffe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.502560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:00.511316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:00.518993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 115/233] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:00.525933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-814efb7f-c433-4384-b725-a076e2cffe98 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:00.526655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.527447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-814efb7f-c433-4384-b725-a076e2cffe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:00.540485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 119/234] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:00.540896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea233b-e206-483e-bf7a-62cae71931df admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.542706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814efb7f-c433-4384-b725-a076e2cffe98 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.551342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.552083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.552363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.552637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.554109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:00.554421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.556383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.559992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814efb7f-c433-4384-b725-a076e2cffe98 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.574015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.576349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.576777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.581009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.582160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 116/235] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:00.586573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.607107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a545c42-ecee-41c7-8bc3-0b8e87d84c55 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.608396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:00.616268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.617142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.618679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:00.618975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.619467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.620491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 120/236] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:00.622074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.642305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462b63b-d310-4732-bf62-3bc3c22ccc00 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.646051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:00.652655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.654231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.654676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.655201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] PATH_INFO: `/v3/users/e8b145a06507479ca4b566f649839972` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.657372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] RBAC: Authorizing `identity:get_user(user_id=e8b145a06507479ca4b566f649839972)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.659524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:00.661714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.662014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 117/237] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:00.663368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.664743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 121/238] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/users/e8b145a06507479ca4b566f649839972 => generated 293 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:00.679040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.682074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139dc8b-d6c3-47d0-845c-5873d992d181 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.687081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.688198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.688660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.689110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.690148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:00.690673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.692615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.698978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0489c046-db31-43b8-bca7-8cdfee867b34 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.705260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 118/239] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:00.707736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.709607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.712534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.712994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.713507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] PATH_INFO: `/v3/system/users/e8b145a06507479ca4b566f649839972/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.715376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e8b145a06507479ca4b566f649839972, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.716684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:00.716684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:00.716684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:00.717977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.723190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768bccc-82bc-46bc-a379-673cf4921693 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.730006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.730807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.731098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.731466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.732344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:00.732851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.733725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 122/240] 10.222.0.31 () {58 vars in 1355 bytes} [Tue Nov 16 03:04:00 2021] PUT /identity/v3/system/users/e8b145a06507479ca4b566f649839972/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:00.737595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.739613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.760034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 119/241] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:00.763391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b635-cab3-47a6-a48f-cdfc56169de1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.770381 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.780526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.782874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.782993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.784379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661e4b-89f5-4041-8542-3afe15eceed7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.785013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.787349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.790923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.795459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 123/242] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:00.796264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.797279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.797688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.798073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] PATH_INFO: `/v3/users/5029a5f098df4602a858aca99c122b4e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.799887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] RBAC: Authorizing `identity:get_user(user_id=5029a5f098df4602a858aca99c122b4e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.803102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.805745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 120/243] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/users/5029a5f098df4602a858aca99c122b4e => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:00.811235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.816803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.840535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b58ec-9495-4d3f-82ec-12f9f5fadffd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.849692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8fbc-b76d-4d75-8b09-af4dfd5d4dd4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.857983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.861351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.862169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.862620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.866330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:00.870125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:00.870643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:00.871631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:00.896194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.902256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.904612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:00.912730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:00.941570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 121/244] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:00.950431 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 124/245] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:00.957712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.959967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:00.987986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65327afc-b6ce-44db-a7f6-59ff587929e3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:00.988992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a0eff-ae8b-45c3-a319-04e9c3e58a11 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:01.000207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.005387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.005387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.005387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.008449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.009324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.009835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.011538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:01.013742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.015611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:01.015823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:01.018296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:01.019653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 122/246] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:01.020566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 125/247] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:00 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:01.031001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:01.032409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:01.043598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5bec90-510e-4ffd-9187-996ac046206b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:01.050602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12fb2d-b678-49ea-8adc-3a6fd86176e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.051663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12fb2d-b678-49ea-8adc-3a6fd86176e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.052212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12fb2d-b678-49ea-8adc-3a6fd86176e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.052606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee77cd-c317-4b07-9638-85263e126e66 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:01.052944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12fb2d-b678-49ea-8adc-3a6fd86176e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.054111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12fb2d-b678-49ea-8adc-3a6fd86176e4 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=1553b5a1fd044efd942a69ded741565d, user.id=a95f866674d64e91af100063311f9b6a) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:01.054698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12fb2d-b678-49ea-8adc-3a6fd86176e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:01.057482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c12fb2d-b678-49ea-8adc-3a6fd86176e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:01.061636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b8603-8e6b-4013-9ebf-daff8052ec61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.062806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8603-8e6b-4013-9ebf-daff8052ec61 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.063331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8603-8e6b-4013-9ebf-daff8052ec61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.063798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b8603-8e6b-4013-9ebf-daff8052ec61 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.065375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b8603-8e6b-4013-9ebf-daff8052ec61 admin admin] RBAC: Adding query filter params (role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=1553b5a1fd044efd942a69ded741565d, user.id=5029a5f098df4602a858aca99c122b4e) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:01.066000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b8603-8e6b-4013-9ebf-daff8052ec61 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:01.066766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 126/248] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:01 2021] GET /identity/v3/role_assignments?user.id=a95f866674d64e91af100063311f9b6a&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:01.069700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970b8603-8e6b-4013-9ebf-daff8052ec61 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:01.090054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 123/249] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:01 2021] GET /identity/v3/role_assignments?user.id=5029a5f098df4602a858aca99c122b4e&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 608 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:01.734811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509b1f0-5a87-433e-911a-1410461f76b1 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.735503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509b1f0-5a87-433e-911a-1410461f76b1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.735784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509b1f0-5a87-433e-911a-1410461f76b1 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.739119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 127/250] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:01 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:01.745828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f1282-e99d-4f62-8193-1e52e48e8876 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.746574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f1282-e99d-4f62-8193-1e52e48e8876 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.746574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f1282-e99d-4f62-8193-1e52e48e8876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.766131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a77f1282-e99d-4f62-8193-1e52e48e8876 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:01.767467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a77f1282-e99d-4f62-8193-1e52e48e8876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:01.775943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 124/251] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:01.801267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509b1f0-5a87-433e-911a-1410461f76b1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:01.817559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509b1f0-5a87-433e-911a-1410461f76b1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:01.822102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.825662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.825662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.825662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.840785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:01.848145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 16 03:04:01.849726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 128/252] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:01 2021] GET /identity/v3/roles/reader => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:01.856821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f1282-e99d-4f62-8193-1e52e48e8876 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:01.873336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f1282-e99d-4f62-8193-1e52e48e8876 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:01.880699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.882182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.882657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.883126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.884495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:01.885014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:01.888480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:01.903334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 125/253] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:01 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:01.910000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:01.922145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555eff7-7012-4f1e-93aa-be1bde405602 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:01.928004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28805025-bbfc-45de-b5d3-25fb6f588f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.928925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28805025-bbfc-45de-b5d3-25fb6f588f48 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.929173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28805025-bbfc-45de-b5d3-25fb6f588f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.929470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28805025-bbfc-45de-b5d3-25fb6f588f48 admin admin] PATH_INFO: `/v3/users/324bde219ace42ef8a6623f13f79ef47` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.945880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28805025-bbfc-45de-b5d3-25fb6f588f48 admin admin] RBAC: Authorizing `identity:get_user(user_id=324bde219ace42ef8a6623f13f79ef47)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:01.948092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28805025-bbfc-45de-b5d3-25fb6f588f48 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:01.950131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 129/254] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:04:01 2021] GET /identity/v3/users/324bde219ace42ef8a6623f13f79ef47 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:01.956741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:01.969029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d21304-6e3b-452b-8a9e-4fd539190d53 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:01.973823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530a773-8995-470c-98d6-08cb01e59d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:01.974498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530a773-8995-470c-98d6-08cb01e59d27 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:01.974797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530a773-8995-470c-98d6-08cb01e59d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:01.975053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530a773-8995-470c-98d6-08cb01e59d27 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:01.975917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530a773-8995-470c-98d6-08cb01e59d27 admin admin] RBAC: Adding query filter params (role.id=b701ff2529444fb58c94774254448315, user.id=324bde219ace42ef8a6623f13f79ef47, scope.system=all) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:01.976230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530a773-8995-470c-98d6-08cb01e59d27 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:01.978260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530a773-8995-470c-98d6-08cb01e59d27 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:01.987666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 126/255] 10.222.0.31 () {56 vars in 1329 bytes} [Tue Nov 16 03:04:01 2021] GET /identity/v3/role_assignments?user.id=324bde219ace42ef8a6623f13f79ef47&scope.system=all&role.id=b701ff2529444fb58c94774254448315 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:02.271268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5cc3a-bca2-4a94-a8ce-ab28c90831f4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:02.271645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5cc3a-bca2-4a94-a8ce-ab28c90831f4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:02.272097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5cc3a-bca2-4a94-a8ce-ab28c90831f4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:02.275678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 130/256] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:02 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:02.285177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131898-83bd-4b55-b3b4-55001755b15c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:02.285505 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131898-83bd-4b55-b3b4-55001755b15c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:02.285881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131898-83bd-4b55-b3b4-55001755b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:02.307387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-01131898-83bd-4b55-b3b4-55001755b15c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:02.308608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-01131898-83bd-4b55-b3b4-55001755b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:02.318146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 127/257] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:02.341749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5cc3a-bca2-4a94-a8ce-ab28c90831f4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:02.355053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5cc3a-bca2-4a94-a8ce-ab28c90831f4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:02.359783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb5444-fb50-4c7a-b936-ba1f31938c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:02.360708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb5444-fb50-4c7a-b936-ba1f31938c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:02.360993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb5444-fb50-4c7a-b936-ba1f31938c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:02.361271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb5444-fb50-4c7a-b936-ba1f31938c58 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:02.362569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb5444-fb50-4c7a-b936-ba1f31938c58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:02.364297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb5444-fb50-4c7a-b936-ba1f31938c58 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:02.366236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 131/258] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:02.372937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131898-83bd-4b55-b3b4-55001755b15c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:02.388768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131898-83bd-4b55-b3b4-55001755b15c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:02.396231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af02fad-c99a-4be8-8ec8-a886011aefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:02.397336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af02fad-c99a-4be8-8ec8-a886011aefee admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:02.397849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af02fad-c99a-4be8-8ec8-a886011aefee admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:02.398306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af02fad-c99a-4be8-8ec8-a886011aefee admin admin] PATH_INFO: `/v3/groups` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:02.399535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af02fad-c99a-4be8-8ec8-a886011aefee admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:02.401321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-0af02fad-c99a-4be8-8ec8-a886011aefee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:02.401321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:02.401321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:02.403786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af02fad-c99a-4be8-8ec8-a886011aefee admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:02.426335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 128/259] 10.222.0.31 () {60 vars in 1155 bytes} [Tue Nov 16 03:04:02 2021] POST /identity/v3/groups => generated 229 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:04:03.377419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc8eb-6412-4c1a-b65a-95a3cb228a6e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:03.377994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc8eb-6412-4c1a-b65a-95a3cb228a6e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:03.377994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6bc8eb-6412-4c1a-b65a-95a3cb228a6e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:03.379838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 132/260] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:03.386401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf90b-aa3f-4e45-bf9f-7906747a87fb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:03.387166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf90b-aa3f-4e45-bf9f-7906747a87fb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:03.387166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdf90b-aa3f-4e45-bf9f-7906747a87fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:03.406612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b3cdf90b-aa3f-4e45-bf9f-7906747a87fb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:03.407837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b3cdf90b-aa3f-4e45-bf9f-7906747a87fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:03.416304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 129/261] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:03 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:03.441171 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc8eb-6412-4c1a-b65a-95a3cb228a6e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:03.453830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6bc8eb-6412-4c1a-b65a-95a3cb228a6e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:03.458350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:03.459157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:03.459435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:03.459700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:03.471210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:03.478399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:03.480015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 133/262] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:03.487339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdf90b-aa3f-4e45-bf9f-7906747a87fb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:03.502293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdf90b-aa3f-4e45-bf9f-7906747a87fb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:03.509359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:03.510501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:03.510974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:03.511444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:03.512835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:03.513360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:03.516346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:03.532705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 130/263] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:03.539765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:03.551180 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1b6cb-46f6-4a9a-abd7-a7388750d1f4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:03.556808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1456c2-949f-4610-8f33-1361cf1c6f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:03.557845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1456c2-949f-4610-8f33-1361cf1c6f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:03.558177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1456c2-949f-4610-8f33-1361cf1c6f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:03.558460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1456c2-949f-4610-8f33-1361cf1c6f2a admin admin] PATH_INFO: `/v3/users/e8b145a06507479ca4b566f649839972` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:03.559937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1456c2-949f-4610-8f33-1361cf1c6f2a admin admin] RBAC: Authorizing `identity:get_user(user_id=e8b145a06507479ca4b566f649839972)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:03.562533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1456c2-949f-4610-8f33-1361cf1c6f2a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:03.564845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 134/264] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:04:03 2021] GET /identity/v3/users/e8b145a06507479ca4b566f649839972 => generated 293 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:03.571277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:03.582823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72049a-58b8-48b7-ad08-bab47dad457f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:03.588302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7faa90a-405e-4bd4-9dce-78cf1fc0cbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:03.588973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa90a-405e-4bd4-9dce-78cf1fc0cbcc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:03.589237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa90a-405e-4bd4-9dce-78cf1fc0cbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:03.589552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7faa90a-405e-4bd4-9dce-78cf1fc0cbcc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:03.590410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faa90a-405e-4bd4-9dce-78cf1fc0cbcc admin admin] RBAC: Adding query filter params (role.id=b47636c54d4f488b8ee95139571f50ca, user.id=e8b145a06507479ca4b566f649839972, scope.system=all) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:03.590719 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faa90a-405e-4bd4-9dce-78cf1fc0cbcc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:03.592617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7faa90a-405e-4bd4-9dce-78cf1fc0cbcc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:03.610861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 131/265] 10.222.0.31 () {56 vars in 1329 bytes} [Tue Nov 16 03:04:03 2021] GET /identity/v3/role_assignments?user.id=e8b145a06507479ca4b566f649839972&scope.system=all&role.id=b47636c54d4f488b8ee95139571f50ca => generated 510 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:04.640176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23fa13-1ea8-4e3b-9018-0b9ce4956cb0 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:04.640874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23fa13-1ea8-4e3b-9018-0b9ce4956cb0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:04.641179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23fa13-1ea8-4e3b-9018-0b9ce4956cb0 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:04.644638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 135/266] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:04 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:04.654816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf34a4-f574-45bd-85af-d909bfcd0e0e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:04.655666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf34a4-f574-45bd-85af-d909bfcd0e0e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:04.655823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf34a4-f574-45bd-85af-d909bfcd0e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:04.676436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f3bf34a4-f574-45bd-85af-d909bfcd0e0e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:04.677940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f3bf34a4-f574-45bd-85af-d909bfcd0e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:04.686346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 132/267] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:04.710535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23fa13-1ea8-4e3b-9018-0b9ce4956cb0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:04.723999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23fa13-1ea8-4e3b-9018-0b9ce4956cb0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:04.728712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:04.729668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:04.730019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:04.730363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:04.742952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:04.750329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 16 03:04:04.751997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 136/268] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:04 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:04.758921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf34a4-f574-45bd-85af-d909bfcd0e0e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:04.769033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf34a4-f574-45bd-85af-d909bfcd0e0e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:04.774138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:04.775115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:04.775533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:04.775875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:04.776734 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:04.777145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:04.778964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:04.789314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 133/269] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:04 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:04.796304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:04.808028 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6de6cd-f526-4bbf-b25e-726ccb3990dd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:04.814755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f05fc3-0e47-4da2-ae6f-5054a09c8446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:04.815767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05fc3-0e47-4da2-ae6f-5054a09c8446 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:04.816100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05fc3-0e47-4da2-ae6f-5054a09c8446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:04.816428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f05fc3-0e47-4da2-ae6f-5054a09c8446 admin admin] PATH_INFO: `/v3/users/324bde219ace42ef8a6623f13f79ef47` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:04.818000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f05fc3-0e47-4da2-ae6f-5054a09c8446 admin admin] RBAC: Authorizing `identity:get_user(user_id=324bde219ace42ef8a6623f13f79ef47)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:04.820370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f05fc3-0e47-4da2-ae6f-5054a09c8446 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:04.822301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 137/270] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:04:04 2021] GET /identity/v3/users/324bde219ace42ef8a6623f13f79ef47 => generated 293 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:04.832159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:04.843786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af1071-8e41-47a9-a0bd-8b9cc1a8094e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:04.849081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc3dce-3ebe-4076-b799-c1b4c4f19fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:04.850291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc3dce-3ebe-4076-b799-c1b4c4f19fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:04.850755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc3dce-3ebe-4076-b799-c1b4c4f19fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:04.851127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc3dce-3ebe-4076-b799-c1b4c4f19fc0 admin admin] PATH_INFO: `/v3/system/users/324bde219ace42ef8a6623f13f79ef47/roles/b701ff2529444fb58c94774254448315` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:04.853193 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc3dce-3ebe-4076-b799-c1b4c4f19fc0 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=324bde219ace42ef8a6623f13f79ef47, role_id=b701ff2529444fb58c94774254448315)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:04.854412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-8dfc3dce-3ebe-4076-b799-c1b4c4f19fc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:04.854412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:04.854412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:04.855538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc3dce-3ebe-4076-b799-c1b4c4f19fc0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:04.867212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 134/271] 10.222.0.31 () {58 vars in 1355 bytes} [Tue Nov 16 03:04:04 2021] PUT /identity/v3/system/users/324bde219ace42ef8a6623f13f79ef47/roles/b701ff2529444fb58c94774254448315 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:04:05.127699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f19e8-bc0f-4973-9b36-3f77b6540c92 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:05.128159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f19e8-bc0f-4973-9b36-3f77b6540c92 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:05.128598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f19e8-bc0f-4973-9b36-3f77b6540c92 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:05.131014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 138/272] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:05.138408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb8bc5-af34-4a62-82ca-807b90e881c8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:05.138752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb8bc5-af34-4a62-82ca-807b90e881c8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:05.139119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb8bc5-af34-4a62-82ca-807b90e881c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:05.160912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b9fb8bc5-af34-4a62-82ca-807b90e881c8 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:05.162759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b9fb8bc5-af34-4a62-82ca-807b90e881c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:05.171220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 135/273] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:05.196245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f19e8-bc0f-4973-9b36-3f77b6540c92 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:05.210568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f19e8-bc0f-4973-9b36-3f77b6540c92 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:05.215757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90d4db-4ca9-4881-9e45-8fbba41c4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:05.216765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d4db-4ca9-4881-9e45-8fbba41c4d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:05.217153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d4db-4ca9-4881-9e45-8fbba41c4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:05.217548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90d4db-4ca9-4881-9e45-8fbba41c4d0a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:05.219282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d4db-4ca9-4881-9e45-8fbba41c4d0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:05.221457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90d4db-4ca9-4881-9e45-8fbba41c4d0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:05.223578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 139/274] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:05.230649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb8bc5-af34-4a62-82ca-807b90e881c8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:05.241025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb8bc5-af34-4a62-82ca-807b90e881c8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:05.246192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f625ce-7381-444b-91a3-287a9f53f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:05.246998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f625ce-7381-444b-91a3-287a9f53f041 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:05.247379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f625ce-7381-444b-91a3-287a9f53f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:05.247713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f625ce-7381-444b-91a3-287a9f53f041 admin admin] PATH_INFO: `/v3/groups` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:05.248525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f625ce-7381-444b-91a3-287a9f53f041 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:05.251531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f625ce-7381-444b-91a3-287a9f53f041 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:05.268219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 136/275] 10.222.0.31 () {60 vars in 1155 bytes} [Tue Nov 16 03:04:05 2021] POST /identity/v3/groups => generated 226 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:04:07.321648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678dca-49de-4be8-ab0f-be6da1a41053 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:07.323055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678dca-49de-4be8-ab0f-be6da1a41053 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:07.323848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81678dca-49de-4be8-ab0f-be6da1a41053 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:07.327779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 140/276] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:07 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:07.335702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e849d48-fa97-47d0-ac1b-2305a60bba02 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:07.337150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e849d48-fa97-47d0-ac1b-2305a60bba02 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:07.337932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e849d48-fa97-47d0-ac1b-2305a60bba02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:07.373171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8e849d48-fa97-47d0-ac1b-2305a60bba02 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:07.375806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8e849d48-fa97-47d0-ac1b-2305a60bba02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:07.393960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 137/277] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:07.432865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678dca-49de-4be8-ab0f-be6da1a41053 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:07.460361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81678dca-49de-4be8-ab0f-be6da1a41053 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:07.467952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:07.470365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:07.471121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:07.471834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:07.496566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:07.515772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 16 03:04:07.519415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 141/278] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:07 2021] GET /identity/v3/roles/reader => generated 84 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:07.526428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e849d48-fa97-47d0-ac1b-2305a60bba02 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:07.548273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e849d48-fa97-47d0-ac1b-2305a60bba02 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:07.560223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:07.561905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:07.562810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:07.563568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:07.565259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:07.566096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:07.569346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:07.588657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 138/279] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:07 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:07.595828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:07.618743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c2c35-0e8e-4149-b157-b4b732b78d92 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:07.626934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93808829-9046-49a4-b61d-fe248111444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:07.628916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93808829-9046-49a4-b61d-fe248111444a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:07.629778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93808829-9046-49a4-b61d-fe248111444a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:07.630520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93808829-9046-49a4-b61d-fe248111444a admin admin] PATH_INFO: `/v3/users/324bde219ace42ef8a6623f13f79ef47` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:07.638912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93808829-9046-49a4-b61d-fe248111444a admin admin] RBAC: Authorizing `identity:get_user(user_id=324bde219ace42ef8a6623f13f79ef47)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:07.643634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93808829-9046-49a4-b61d-fe248111444a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:07.647326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 142/280] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:04:07 2021] GET /identity/v3/users/324bde219ace42ef8a6623f13f79ef47 => generated 293 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:07.654818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:07.674630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb6712-0186-4468-8bb8-8f8a314b77c0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:07.692237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae3aeb-7f25-4058-981a-335a3062bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:07.693382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3aeb-7f25-4058-981a-335a3062bada admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:07.693944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3aeb-7f25-4058-981a-335a3062bada admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:07.694438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3aeb-7f25-4058-981a-335a3062bada admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:07.696079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3aeb-7f25-4058-981a-335a3062bada admin admin] RBAC: Adding query filter params (role.id=b701ff2529444fb58c94774254448315, user.id=324bde219ace42ef8a6623f13f79ef47, scope.system=all) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:07.696640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3aeb-7f25-4058-981a-335a3062bada admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:07.700365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3aeb-7f25-4058-981a-335a3062bada admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:07.735951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 139/281] 10.222.0.31 () {56 vars in 1329 bytes} [Tue Nov 16 03:04:07 2021] GET /identity/v3/role_assignments?user.id=324bde219ace42ef8a6623f13f79ef47&scope.system=all&role.id=b701ff2529444fb58c94774254448315 => generated 510 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:09.400986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e190-11c5-4b22-87cf-06886e77af03 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:09.401868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e190-11c5-4b22-87cf-06886e77af03 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:09.402032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99e190-11c5-4b22-87cf-06886e77af03 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:09.405270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 143/282] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:09.417594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d639d28-21aa-42c1-a9f4-5cea3ec8fde3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:09.418392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d639d28-21aa-42c1-a9f4-5cea3ec8fde3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:09.418553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d639d28-21aa-42c1-a9f4-5cea3ec8fde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:09.462062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5d639d28-21aa-42c1-a9f4-5cea3ec8fde3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:09.464124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5d639d28-21aa-42c1-a9f4-5cea3ec8fde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:09.485417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 140/283] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:09.563787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e190-11c5-4b22-87cf-06886e77af03 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:09.596459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99e190-11c5-4b22-87cf-06886e77af03 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:09.607672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:09.609158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:09.609670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:09.610128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:09.634862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:09.652148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:09.654574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 144/284] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:09.665548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d639d28-21aa-42c1-a9f4-5cea3ec8fde3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:09.686747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d639d28-21aa-42c1-a9f4-5cea3ec8fde3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:09.700265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:09.701919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:09.703161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:09.704014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:09.705853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:09.706657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:09.714040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:09.735929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 141/285] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:09.746649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:09.770586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85b223-fcb4-4108-b700-a657885003ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:09.787869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:09.788946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:09.789454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:09.789914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:09.813579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:09.817082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:09.837530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 145/286] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:09 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:09.845989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:09.872203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d2035-af3c-426b-9c0f-b5ff15f291ce admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:09.886273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:09.887177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:09.887445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:09.887713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:09.889078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:09.891391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:09.893519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 142/287] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:09 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:09.903667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:09.927943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d26f7-9efb-4cc1-8bbd-2f1b72b5e4dc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:09.943217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17483db1-e1fc-4640-8373-092b8600dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:09.944828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483db1-e1fc-4640-8373-092b8600dd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:09.945319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483db1-e1fc-4640-8373-092b8600dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:09.945931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17483db1-e1fc-4640-8373-092b8600dd2d admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:09.965516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17483db1-e1fc-4640-8373-092b8600dd2d admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:09.967291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-17483db1-e1fc-4640-8373-092b8600dd2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:09.967291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:09.967291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:09.970269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17483db1-e1fc-4640-8373-092b8600dd2d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:09.973223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 146/288] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:09 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:09.983750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.004280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ea3b3-428b-45f7-b332-338a603df31f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.014088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189b07b-1531-429b-b1ef-e39265170d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.014776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b07b-1531-429b-b1ef-e39265170d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.015039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b07b-1531-429b-b1ef-e39265170d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.017644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189b07b-1531-429b-b1ef-e39265170d65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.018578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b07b-1531-429b-b1ef-e39265170d65 admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:10.018891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b07b-1531-429b-b1ef-e39265170d65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.020789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189b07b-1531-429b-b1ef-e39265170d65 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.034985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 143/289] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:09 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 260 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:10.315978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60d5b3-d8e5-4a5b-8e5d-b4a35db40d65 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.316484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60d5b3-d8e5-4a5b-8e5d-b4a35db40d65 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.316896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60d5b3-d8e5-4a5b-8e5d-b4a35db40d65 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.320352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 147/290] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:10.328582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52687-95c1-4e64-b9b8-551d02cb61de None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.329302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52687-95c1-4e64-b9b8-551d02cb61de None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.329828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52687-95c1-4e64-b9b8-551d02cb61de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.375465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1ac52687-95c1-4e64-b9b8-551d02cb61de None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:10.377794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1ac52687-95c1-4e64-b9b8-551d02cb61de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:10.393999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 144/291] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:10.399206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271190d0-c637-4850-a2d0-e11c29a9a837 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.399660 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271190d0-c637-4850-a2d0-e11c29a9a837 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.400144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271190d0-c637-4850-a2d0-e11c29a9a837 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.403945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 148/292] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:10 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:10.418789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc9e6c-fba8-4df4-86b9-3a63fb904e78 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.418789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc9e6c-fba8-4df4-86b9-3a63fb904e78 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.418789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc9e6c-fba8-4df4-86b9-3a63fb904e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.420802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271190d0-c637-4850-a2d0-e11c29a9a837 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.448337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-affc9e6c-fba8-4df4-86b9-3a63fb904e78 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:10.450776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-affc9e6c-fba8-4df4-86b9-3a63fb904e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:10.460288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271190d0-c637-4850-a2d0-e11c29a9a837 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.466862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 145/293] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:10.478814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.480302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.480843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.481335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.516473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc9e6c-fba8-4df4-86b9-3a63fb904e78 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.525915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:10.547819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:10.552453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc9e6c-fba8-4df4-86b9-3a63fb904e78 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.556266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 149/294] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:10.568054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.579055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.580867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.581718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.582438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.596196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41761c3-82fc-479a-ac78-c605dbfca038 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.607109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.609208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.609208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.609208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.609792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:10.609917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.611526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.616350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:10.624568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 150/295] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:10.630637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:10.631328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.637906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 146/296] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:10.644508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.646678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0296629-ab6d-4d1c-82d3-2937c00ca36b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.651354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.652023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.652302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.652579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.665156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.667095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.669139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929c771-aff5-4a18-8e69-cc133e91fd24 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.677132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.679247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.680140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.680812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.682673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:10.683497 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.685210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 151/297] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:10.686950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.689207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.698607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58184ee0-6628-43b3-a7a4-5e524d729490 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.703696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.704611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.704894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.705168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.706730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.709316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.711239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 147/298] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:10.717476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 152/299] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:10.718917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.723258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.732709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fa9b5-8b88-4e24-98c7-679579b233a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.738135 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.739023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.739297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.739564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.742815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.743877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:10.743877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:10.743877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:10.745104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.750498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473aa517-a407-4e97-ad71-3f65a75c037a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.753201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 148/300] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:10.754779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.760849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.763327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.764565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.765408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.766641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb989a97-c955-417f-9b18-4a957b31de49 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.771552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.772236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.772516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.772792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.774560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:10.774885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.776871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.789622 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 149/301] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=b47636c54d4f488b8ee95139571f50ca => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:10.790193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.794164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.822286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 153/302] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:10.826862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.860095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb0fc4-36d5-45f3-a6f2-7d62ef234caa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.878378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.879295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.879578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.879853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.881262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.883468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.886593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 150/303] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:10.897089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.920053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30c907-19e2-41da-a686-1d4989ed2f7a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.937200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb586dfa-5f63-4826-b296-1d3946c64d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.939103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586dfa-5f63-4826-b296-1d3946c64d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.939785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586dfa-5f63-4826-b296-1d3946c64d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.940444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586dfa-5f63-4826-b296-1d3946c64d8e admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.946991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb586dfa-5f63-4826-b296-1d3946c64d8e admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.951199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb586dfa-5f63-4826-b296-1d3946c64d8e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:10.954772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 154/304] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:10.965862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:10.983775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fe25c-fe52-4584-a529-757a8e663bd8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:10.991746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f020589-c22e-4d5d-bfc7-03a597d9db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:10.992589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020589-c22e-4d5d-bfc7-03a597d9db8f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:10.993011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020589-c22e-4d5d-bfc7-03a597d9db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:10.993411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f020589-c22e-4d5d-bfc7-03a597d9db8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:10.994522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f020589-c22e-4d5d-bfc7-03a597d9db8f admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=1553b5a1fd044efd942a69ded741565d) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:10.994950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f020589-c22e-4d5d-bfc7-03a597d9db8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:10.997069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f020589-c22e-4d5d-bfc7-03a597d9db8f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:11.011073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 151/305] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:10 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=b47636c54d4f488b8ee95139571f50ca => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:11.230788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d010b-6753-4a5e-8288-8ca7be7603ba None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.231596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d010b-6753-4a5e-8288-8ca7be7603ba None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.232322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d010b-6753-4a5e-8288-8ca7be7603ba None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.236046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 155/306] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:11 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:11.243093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24629-0303-4932-8dd3-1b2316cfbcb0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.243520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24629-0303-4932-8dd3-1b2316cfbcb0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.243894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b24629-0303-4932-8dd3-1b2316cfbcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.274737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e5b24629-0303-4932-8dd3-1b2316cfbcb0 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:11.275969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e5b24629-0303-4932-8dd3-1b2316cfbcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:11.284907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 152/307] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:11.322543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d010b-6753-4a5e-8288-8ca7be7603ba None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:11.358567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d010b-6753-4a5e-8288-8ca7be7603ba None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:11.370021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:11.371972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.372717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.373403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.391563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:11.399178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:11.400825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 156/308] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:11.407273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b24629-0303-4932-8dd3-1b2316cfbcb0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:11.418697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b24629-0303-4932-8dd3-1b2316cfbcb0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:11.423539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:11.424480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.424623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.424959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.425683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:11.425988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:11.427655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:11.439926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 153/309] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:11.446513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:11.580035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357184d-2617-4952-8ccb-0a908171f4c9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:11.584647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:11.585348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.585659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.585935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.595387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:11.597186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:11.607545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 157/310] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:11 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:11.614930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:11.639055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437bc0c-e5e1-4454-b368-82986555df1b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:11.655062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:11.657791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.658627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.659387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.662362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:11.666860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:11.675170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 154/311] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:11 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:11.680983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:11.695287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc297bd5-b749-42a9-a4ca-d7902560a88a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:11.703741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0bd63-0c56-4275-8dab-1a00f09293dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:11.704610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0bd63-0c56-4275-8dab-1a00f09293dd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.704884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0bd63-0c56-4275-8dab-1a00f09293dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.705147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0bd63-0c56-4275-8dab-1a00f09293dd admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.706381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0bd63-0c56-4275-8dab-1a00f09293dd admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:11.708358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0bd63-0c56-4275-8dab-1a00f09293dd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:11.716122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 158/312] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:11 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:11.718267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:11.743444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196cb0b-94d3-4abc-a859-4f1da44e9889 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:11.756041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc489c-c458-45be-b3ed-8ba00c8ed87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:11.757755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc489c-c458-45be-b3ed-8ba00c8ed87c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:11.762447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc489c-c458-45be-b3ed-8ba00c8ed87c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:11.763512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc489c-c458-45be-b3ed-8ba00c8ed87c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:11.765648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc489c-c458-45be-b3ed-8ba00c8ed87c admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=1553b5a1fd044efd942a69ded741565d) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:11.766557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc489c-c458-45be-b3ed-8ba00c8ed87c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:11.770748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc489c-c458-45be-b3ed-8ba00c8ed87c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:11.787162 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 155/313] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:11 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 260 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:12.150732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29423f34-d3aa-46d5-b268-d2b459593fbe None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.151193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29423f34-d3aa-46d5-b268-d2b459593fbe None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.151537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29423f34-d3aa-46d5-b268-d2b459593fbe None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.159221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 159/314] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:12 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:12.167539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e5fd2-4b68-4c49-b951-19b03889a83d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.167990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e5fd2-4b68-4c49-b951-19b03889a83d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.168451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e5fd2-4b68-4c49-b951-19b03889a83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.204691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6c4e5fd2-4b68-4c49-b951-19b03889a83d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:12.206823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6c4e5fd2-4b68-4c49-b951-19b03889a83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:12.221704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 156/315] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:12.250774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29423f34-d3aa-46d5-b268-d2b459593fbe None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:12.277506 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29423f34-d3aa-46d5-b268-d2b459593fbe None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:12.288895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:12.290336 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.290822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.291318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.321214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:12.335265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:12.340799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 160/316] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:12.344737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e5fd2-4b68-4c49-b951-19b03889a83d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:12.364589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e5fd2-4b68-4c49-b951-19b03889a83d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:12.376993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:12.378147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.378629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.379192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.380755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:12.381286 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:12.384739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:12.405368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 157/317] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:12.412864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:12.434681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d1f05-7398-4c58-8571-23305735f6c1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:12.444508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:12.445661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.446128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.446659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.469847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:12.473164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:12.496132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 161/318] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:12 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:12.503446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:12.526355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a280cad-eaed-460c-b3e2-6ff64a3b5f38 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:12.538142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:12.539758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.540286 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.540762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] PATH_INFO: `/v3/projects/fb897d934c0d40faa98082f63fe4c388` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.546103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] RBAC: Authorizing `identity:get_project(project_id=fb897d934c0d40faa98082f63fe4c388)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:12.550018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:12.553598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 158/319] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:12 2021] GET /identity/v3/projects/fb897d934c0d40faa98082f63fe4c388 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:12.561941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:12.581368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdd124-b6a5-4971-9a78-6eca6b81c3a1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:12.593728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99f0cc-80e0-4504-b679-d91dbfeb6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:12.595232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99f0cc-80e0-4504-b679-d91dbfeb6fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.595746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99f0cc-80e0-4504-b679-d91dbfeb6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.596213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99f0cc-80e0-4504-b679-d91dbfeb6fbf admin admin] PATH_INFO: `/v3/groups/1d7f0d9cbe164b7cbd94f4cbdf643226` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.606844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99f0cc-80e0-4504-b679-d91dbfeb6fbf admin admin] RBAC: Authorizing `identity:get_group(group_id=1d7f0d9cbe164b7cbd94f4cbdf643226)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:12.610848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99f0cc-80e0-4504-b679-d91dbfeb6fbf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:12.614348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 162/320] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:12 2021] GET /identity/v3/groups/1d7f0d9cbe164b7cbd94f4cbdf643226 => generated 229 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:12.621522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:12.641466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016492eb-ee30-41c7-abca-3244fbd4d58a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:12.652421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0465a35-07b7-4d97-a2c6-914b839c968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:12.653592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465a35-07b7-4d97-a2c6-914b839c968d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:12.654145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465a35-07b7-4d97-a2c6-914b839c968d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:12.654634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465a35-07b7-4d97-a2c6-914b839c968d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:12.656792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0465a35-07b7-4d97-a2c6-914b839c968d admin admin] RBAC: Adding query filter params (group.id=1d7f0d9cbe164b7cbd94f4cbdf643226, role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=fb897d934c0d40faa98082f63fe4c388) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:12.657225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0465a35-07b7-4d97-a2c6-914b839c968d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:12.661610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0465a35-07b7-4d97-a2c6-914b839c968d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:12.675165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 159/321] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:12 2021] GET /identity/v3/role_assignments?group.id=1d7f0d9cbe164b7cbd94f4cbdf643226&scope.project.id=fb897d934c0d40faa98082f63fe4c388&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 260 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:14.569596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae76d-f4f6-479d-b00e-40f9c5f36228 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.570176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae76d-f4f6-479d-b00e-40f9c5f36228 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.570176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae76d-f4f6-479d-b00e-40f9c5f36228 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.571962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 163/322] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:14.580491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49c3b-3293-4609-8036-aabf64be79c5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.581075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49c3b-3293-4609-8036-aabf64be79c5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.581075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f49c3b-3293-4609-8036-aabf64be79c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.605924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-96f49c3b-3293-4609-8036-aabf64be79c5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:14.607177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-96f49c3b-3293-4609-8036-aabf64be79c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:14.621606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 160/323] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:14.659275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbae76d-f4f6-479d-b00e-40f9c5f36228 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:14.673214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbae76d-f4f6-479d-b00e-40f9c5f36228 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:14.680269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:14.681087 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.681362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.681664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.693733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:14.701032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:14.702953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 164/324] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:14.709598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f49c3b-3293-4609-8036-aabf64be79c5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:14.719371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f49c3b-3293-4609-8036-aabf64be79c5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:14.729825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d70a3-da9c-47aa-afcc-1140ad6f50d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:14.730581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d70a3-da9c-47aa-afcc-1140ad6f50d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.730862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d70a3-da9c-47aa-afcc-1140ad6f50d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.731242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d70a3-da9c-47aa-afcc-1140ad6f50d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.732206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d70a3-da9c-47aa-afcc-1140ad6f50d4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:14.732503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d70a3-da9c-47aa-afcc-1140ad6f50d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:14.734316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d70a3-da9c-47aa-afcc-1140ad6f50d4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:14.751264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 161/325] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:14.758198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:14.769848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2dcdd-55be-4780-bee6-824a0cfe7562 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.771668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2dcdd-55be-4780-bee6-824a0cfe7562 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.772002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2dcdd-55be-4780-bee6-824a0cfe7562 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.774160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 162/326] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:14.778457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90278a-71ca-4226-a58d-fe4b88c2dc1c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:14.781247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2262-6e7a-47c8-b44c-12f0aca26a4e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.781573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2262-6e7a-47c8-b44c-12f0aca26a4e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.781844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d2262-6e7a-47c8-b44c-12f0aca26a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.790165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:14.791042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.791318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.791588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.794641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:14.796722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:14.804911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 165/327] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:14 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:14.810552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:14.813951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-186d2262-6e7a-47c8-b44c-12f0aca26a4e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:14.815562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-186d2262-6e7a-47c8-b44c-12f0aca26a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:14.828538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 163/328] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:14.831757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf8b7c-6e5a-47d8-bcb4-afb77eae6c95 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:14.834420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:14.835283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.835561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.835832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.837032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:14.839221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:14.841254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 166/329] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:14 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:14.847951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d2262-6e7a-47c8-b44c-12f0aca26a4e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:14.856164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:14.858079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d2262-6e7a-47c8-b44c-12f0aca26a4e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:14.864979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:14.865658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.865937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.866209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.873458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d576dc1e4402ab7e6d6363dda4887, group_id=57ef098e1cd04c51bf6ca19faaf257c8, role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:14.873458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:14.875737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc29779-335a-4914-b190-79ed8e604763 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:14.883623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ed6c4-2956-4ef0-ba7b-fa923906c7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:14.884794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ed6c4-2956-4ef0-ba7b-fa923906c7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:14.885296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ed6c4-2956-4ef0-ba7b-fa923906c7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:14.885798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ed6c4-2956-4ef0-ba7b-fa923906c7f3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:14.889489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 164/330] 10.222.0.31 () {58 vars in 1463 bytes} [Tue Nov 16 03:04:14 2021] PUT /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:14.907887 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ed6c4-2956-4ef0-ba7b-fa923906c7f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:14.921480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-0e7ed6c4-2956-4ef0-ba7b-fa923906c7f3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:14.923827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 167/331] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:14.930282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.007132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c88b-a297-4025-88b5-4eff29ce82c8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.007797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c88b-a297-4025-88b5-4eff29ce82c8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.008266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923c88b-a297-4025-88b5-4eff29ce82c8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.010525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 168/332] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:15.017680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdbee-e4e2-4357-8b14-140857fcbd46 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.017987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdbee-e4e2-4357-8b14-140857fcbd46 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.018236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bdbee-e4e2-4357-8b14-140857fcbd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.021690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4d75a-2edc-4ed8-985c-846e20822c49 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.026666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.027362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.027639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.027906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.028701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:15.029015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.031013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.042483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 165/333] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:15.050432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.068881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c5227-dd57-4499-b6ce-3485d86bc32a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.070616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-491bdbee-e4e2-4357-8b14-140857fcbd46 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:15.072220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-491bdbee-e4e2-4357-8b14-140857fcbd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:15.078199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.080377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.080658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.080930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.084902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.089640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 169/334] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:15.090015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.092280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 166/335] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:15 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:15.098663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bdbee-e4e2-4357-8b14-140857fcbd46 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.108905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bdbee-e4e2-4357-8b14-140857fcbd46 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.117374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.120443 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.121404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.121751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.122022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.123335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.125645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.133366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 170/336] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:15 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:15.133714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7b4aa-e60b-4de0-a57b-e53796743e82 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.140128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.150958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.152019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.152302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.152575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.159500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce96dc-b8eb-49e0-938b-93686021e6ea admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.170118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:15.178010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:15.179891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 167/337] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:15 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:15.182160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.183069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.183348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.183620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.187014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.190417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31d576dc1e4402ab7e6d6363dda4887, group_id=57ef098e1cd04c51bf6ca19faaf257c8, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.194068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.204442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e91bc6-38a1-4fc8-a105-6e372b8ad6ba admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.220242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.221402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.222010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.222445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.224583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:15.225984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.227464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 171/338] 10.222.0.31 () {58 vars in 1463 bytes} [Tue Nov 16 03:04:15 2021] PUT /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:15.229338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.241847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 168/339] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:15 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:15.250716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.324500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa08ae5-2cc7-49b6-9f6b-f97272a8413e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.330162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.331467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.331928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.332370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.334034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.336338 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.338441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 172/340] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:15 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:15.346345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.359464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc17df0-ab9a-434b-81a0-63341abad08d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.366028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab9385-a6a8-4f2e-a1bb-492cd71aa260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.367314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9385-a6a8-4f2e-a1bb-492cd71aa260 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.367765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9385-a6a8-4f2e-a1bb-492cd71aa260 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.368248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab9385-a6a8-4f2e-a1bb-492cd71aa260 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.370017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab9385-a6a8-4f2e-a1bb-492cd71aa260 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.372768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab9385-a6a8-4f2e-a1bb-492cd71aa260 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.375791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 169/341] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:15 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:15.382313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:15.394065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172199f-54c1-429d-820a-ba5b80a59067 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:15.399223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f177a-774a-4d6b-953a-7057016c69cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:15.400482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f177a-774a-4d6b-953a-7057016c69cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:15.401050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f177a-774a-4d6b-953a-7057016c69cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:15.401537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f177a-774a-4d6b-953a-7057016c69cc admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:15.404234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f177a-774a-4d6b-953a-7057016c69cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1553b5a1fd044efd942a69ded741565d, group_id=57ef098e1cd04c51bf6ca19faaf257c8, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:15.407576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f177a-774a-4d6b-953a-7057016c69cc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:15.428716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 173/342] 10.222.0.31 () {58 vars in 1463 bytes} [Tue Nov 16 03:04:15 2021] PUT /identity/v3/projects/1553b5a1fd044efd942a69ded741565d/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:04:16.492244 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c5f4d-4c63-44ca-99e3-3445f35a8ede None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.493910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c5f4d-4c63-44ca-99e3-3445f35a8ede None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.494634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c5f4d-4c63-44ca-99e3-3445f35a8ede None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.498628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 170/343] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:16 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:16.506074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e709-f806-44af-a170-d8491b6011d2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.507603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e709-f806-44af-a170-d8491b6011d2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.508334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933e709-f806-44af-a170-d8491b6011d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.546475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a933e709-f806-44af-a170-d8491b6011d2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:16.549187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a933e709-f806-44af-a170-d8491b6011d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:16.676428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 174/344] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:16.699466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7752084-65d6-4b01-8ede-513fd42bd34d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.700374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7752084-65d6-4b01-8ede-513fd42bd34d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.701125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7752084-65d6-4b01-8ede-513fd42bd34d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.705371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 171/345] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:16 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:16.707534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e709-f806-44af-a170-d8491b6011d2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:16.711953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b83b2-c711-4102-adf6-30607b6ac219 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.712284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b83b2-c711-4102-adf6-30607b6ac219 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.712515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b83b2-c711-4102-adf6-30607b6ac219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.725855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933e709-f806-44af-a170-d8491b6011d2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:16.741006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:16.743475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.744555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.745311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.750819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-118b83b2-c711-4102-adf6-30607b6ac219 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:16.751926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-118b83b2-c711-4102-adf6-30607b6ac219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:16.770818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:16.776080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 172/346] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:16.787246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:16.790017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 175/347] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:16.796809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b83b2-c711-4102-adf6-30607b6ac219 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:16.811414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:16.816876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b83b2-c711-4102-adf6-30607b6ac219 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:16.833916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be39b1-6a66-47ce-a675-04a7a8bbe6b6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:16.838285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:16.843455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.844656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.846991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.849504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:16.850422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:16.851872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:16.853098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.855737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.856494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.859919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:16.889956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:16.891392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 173/348] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:16.897896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:16.906602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:16.909746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 176/349] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:16 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:16.920019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf80ec9-11af-41c4-9fbe-d474a27fafc2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:16.935457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:16.935700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:16.937032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.937631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.938097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] PATH_INFO: `/v3/groups/1d7f0d9cbe164b7cbd94f4cbdf643226` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.940212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] RBAC: Authorizing `identity:get_group(group_id=1d7f0d9cbe164b7cbd94f4cbdf643226)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:16.943731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:16.948664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 174/350] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:16 2021] GET /identity/v3/groups/1d7f0d9cbe164b7cbd94f4cbdf643226 => generated 229 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:16.958048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4215590-6a66-4656-81a2-ac2d14a564ef admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:16.960433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:16.971116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:16.971809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.972107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.972390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.973151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:16.973465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:16.975129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:16.978209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530480ec-175a-4899-89f0-ca4fee8f0f1b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:16.985675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:16.987133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:16.987595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:16.988075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] PATH_INFO: `/v3/projects/fb897d934c0d40faa98082f63fe4c388` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:16.990176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] RBAC: Authorizing `identity:get_project(project_id=fb897d934c0d40faa98082f63fe4c388)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:16.993016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 177/351] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:16 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:16.995612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:16.998810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 175/352] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:16 2021] GET /identity/v3/projects/fb897d934c0d40faa98082f63fe4c388 => generated 344 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:17.005881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:17.008249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:17.027797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab08a7-f223-4ef6-bd18-1132d47ca1bb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:17.028081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bfce10-111b-43ab-bbfc-a80ac26d1869 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:17.035620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:17.037396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:17.037945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:17.038379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:17.040692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:17.042719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbbf6c-cccc-4520-931a-ea2fae67c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:17.043626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbbf6c-cccc-4520-931a-ea2fae67c628 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:17.043910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbbf6c-cccc-4520-931a-ea2fae67c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:17.044147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbbf6c-cccc-4520-931a-ea2fae67c628 admin admin] PATH_INFO: `/v3/projects/fb897d934c0d40faa98082f63fe4c388/groups/1d7f0d9cbe164b7cbd94f4cbdf643226/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:17.044427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:17.050950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbbf6c-cccc-4520-931a-ea2fae67c628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb897d934c0d40faa98082f63fe4c388, group_id=1d7f0d9cbe164b7cbd94f4cbdf643226, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:17.053576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 176/353] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:17 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:17.053851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbbf6c-cccc-4520-931a-ea2fae67c628 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:17.057843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:17.079389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68050a-65ff-437f-a368-55c96a7eb489 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:17.084549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:17.085457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:17.086031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:17.086308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:17.087957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:17.089866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:17.097117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 177/354] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:17 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:17.098617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:17.099902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 178/355] 10.222.0.31 () {58 vars in 1463 bytes} [Tue Nov 16 03:04:17 2021] PUT /identity/v3/projects/fb897d934c0d40faa98082f63fe4c388/groups/1d7f0d9cbe164b7cbd94f4cbdf643226/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:04:17.109373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4bae4-baf0-4ff0-ba2f-f54f28e465f0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:17.176286 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee855e5e-9b88-468a-8e34-3b969e337a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:17.177200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855e5e-9b88-468a-8e34-3b969e337a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:17.177514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855e5e-9b88-468a-8e34-3b969e337a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:17.177793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855e5e-9b88-468a-8e34-3b969e337a84 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:17.180186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee855e5e-9b88-468a-8e34-3b969e337a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1553b5a1fd044efd942a69ded741565d, group_id=57ef098e1cd04c51bf6ca19faaf257c8, role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:17.183002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee855e5e-9b88-468a-8e34-3b969e337a84 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:17.209499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 178/356] 10.222.0.31 () {58 vars in 1463 bytes} [Tue Nov 16 03:04:17 2021] PUT /identity/v3/projects/1553b5a1fd044efd942a69ded741565d/groups/57ef098e1cd04c51bf6ca19faaf257c8/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:04:18.419086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddcebd-2032-41e3-a038-e73b0408146e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.420015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddcebd-2032-41e3-a038-e73b0408146e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.420015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddcebd-2032-41e3-a038-e73b0408146e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.422131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 179/357] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:18.428659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546577-a5d6-4a38-b0c0-87313344b37c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.429644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546577-a5d6-4a38-b0c0-87313344b37c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.429644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6546577-a5d6-4a38-b0c0-87313344b37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.458789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a6546577-a5d6-4a38-b0c0-87313344b37c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:18.460045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a6546577-a5d6-4a38-b0c0-87313344b37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:18.548968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 179/358] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:18 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:18.595166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddcebd-2032-41e3-a038-e73b0408146e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:18.612519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddcebd-2032-41e3-a038-e73b0408146e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:18.622231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:18.623063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.623356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.623625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.642694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:18.650161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:18.651456 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 180/359] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:18.659430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6546577-a5d6-4a38-b0c0-87313344b37c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:18.683989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6546577-a5d6-4a38-b0c0-87313344b37c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:18.698165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:18.699809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.700524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.701274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.703218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:18.704148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:18.707979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:18.736521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 180/360] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:18.742781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:18.759533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924897d-0a79-4ffb-8206-a313442df249 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:18.774350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:18.775046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.775315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.775595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.790363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:18.792193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:18.808316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 181/361] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:18.817946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:18.847983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8890c2e-434b-4cb2-8f12-f5cd0a9b7d13 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:18.864761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:18.866981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.867739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.868576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.874235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:18.879371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:18.889487 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 181/362] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:18 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:18.890237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:18.912619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306ca60-4324-4c69-a74f-c07046c85c55 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:18.934937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88110a34-5494-49fc-bb49-2741e52ef34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:18.935827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110a34-5494-49fc-bb49-2741e52ef34b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.936112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110a34-5494-49fc-bb49-2741e52ef34b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.936404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88110a34-5494-49fc-bb49-2741e52ef34b admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.938398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88110a34-5494-49fc-bb49-2741e52ef34b admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:18.940424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88110a34-5494-49fc-bb49-2741e52ef34b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:18.942623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 182/363] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:18 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:18.950009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:18.977322 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52430f-6506-488e-99d5-8c53a3eb163d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:18.991887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc937b-b89d-4732-9238-39dd07687fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:18.993648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc937b-b89d-4732-9238-39dd07687fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:18.994476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc937b-b89d-4732-9238-39dd07687fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:18.995263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc937b-b89d-4732-9238-39dd07687fd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:18.997314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc937b-b89d-4732-9238-39dd07687fd8 admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:18.998301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc937b-b89d-4732-9238-39dd07687fd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.002629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc937b-b89d-4732-9238-39dd07687fd8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.022150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 182/364] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:18 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 611 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:19.238293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d20d3-e8f1-45e2-a9db-a383adb2b03f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.239497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d20d3-e8f1-45e2-a9db-a383adb2b03f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.240275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d20d3-e8f1-45e2-a9db-a383adb2b03f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.244665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 183/365] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:19 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:19.268140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb68242-fac8-40cc-99d5-7abae102835a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.270140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb68242-fac8-40cc-99d5-7abae102835a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.271161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb68242-fac8-40cc-99d5-7abae102835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.315641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4bb68242-fac8-40cc-99d5-7abae102835a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:19.316885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4bb68242-fac8-40cc-99d5-7abae102835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:19.330357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 183/366] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:19.401228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d20d3-e8f1-45e2-a9db-a383adb2b03f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.429581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d20d3-e8f1-45e2-a9db-a383adb2b03f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.440732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.442762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.443520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.444255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.468873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:19.484911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:19.488096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 184/367] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:19.494349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb68242-fac8-40cc-99d5-7abae102835a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.509321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb68242-fac8-40cc-99d5-7abae102835a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.514769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fdd10-5755-4db8-999c-d4170145fc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.515609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fdd10-5755-4db8-999c-d4170145fc5f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.516101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fdd10-5755-4db8-999c-d4170145fc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.516448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fdd10-5755-4db8-999c-d4170145fc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.517253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fdd10-5755-4db8-999c-d4170145fc5f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:19.517599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fdd10-5755-4db8-999c-d4170145fc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.519268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fdd10-5755-4db8-999c-d4170145fc5f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.534100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 184/368] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:19.540966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.553067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e0a743-1e55-4f9e-808e-c54ad08fcbb4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.561289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbc6f-4580-4914-a639-ebd3ea78620c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.561717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbc6f-4580-4914-a639-ebd3ea78620c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.562059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbc6f-4580-4914-a639-ebd3ea78620c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.564708 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 185/369] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:19.565654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.567090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.567909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.568501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.583436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2659-a19f-4ff1-bacb-3da2c66b3ed3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.583969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2659-a19f-4ff1-bacb-3da2c66b3ed3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.584422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d2659-a19f-4ff1-bacb-3da2c66b3ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.593632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.597104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.611216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-875d2659-a19f-4ff1-bacb-3da2c66b3ed3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:19.612694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-875d2659-a19f-4ff1-bacb-3da2c66b3ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:19.628225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 185/371] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:19.628426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 186/371] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:19.630394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.650372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d63cf8-a5fb-4b7e-87e0-2eb0cff87414 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.655424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2659-a19f-4ff1-bacb-3da2c66b3ed3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.658567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.660045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.660613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.661583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.663753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.668040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.668326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d2659-a19f-4ff1-bacb-3da2c66b3ed3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.672633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 186/372] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:19.679201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.680280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.680533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.680885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.681293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.695491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:19.701655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c1876b-b236-466f-8aa5-15f866dd9e0a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.703560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 16 03:04:19.705489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 187/373] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:19.711957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.715026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.716626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.717560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.718528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.721977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.723357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d2b82-2d1a-4cc3-9840-523c4fb8a13e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.726141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.728216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.728884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.729256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.729612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.730259 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 187/374] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:19.730439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] RBAC: Adding query filter params (name=member) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:19.730745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.732394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.740917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.752319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b37ce2c-11e6-4daf-b71b-4f934c72fe18 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.757293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.758326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 188/375] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:19.759493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.760146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.760811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.764285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.765790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=b31d576dc1e4402ab7e6d6363dda4887) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:19.766596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.768891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.784583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524ad2-28b5-4df7-942c-0e418e5b8eee admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.785052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 188/376] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=b31d576dc1e4402ab7e6d6363dda4887&role.id=b47636c54d4f488b8ee95139571f50ca => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:19.792137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.793319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.793822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.794216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.809364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.813021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.830648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 189/377] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:19.837514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.848799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9907e4a8-437d-49ba-8292-89adb4da9fbf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.854052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.855154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.855588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.855964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.857519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.860581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.863118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 189/378] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:19.869884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.880730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee886724-b3c4-4769-9415-143133600a5b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.885910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba92593-ebe7-41d9-9fea-48a32125c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.887021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92593-ebe7-41d9-9fea-48a32125c67c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.887451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92593-ebe7-41d9-9fea-48a32125c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.887819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba92593-ebe7-41d9-9fea-48a32125c67c admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.889401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba92593-ebe7-41d9-9fea-48a32125c67c admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.892284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba92593-ebe7-41d9-9fea-48a32125c67c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.894919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 190/379] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:19.902029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:19.914267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfffa7-a4e0-4ac1-9484-6d116d745d89 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:19.919600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaef867-9080-40ca-a64c-fa5579ae44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:19.920504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaef867-9080-40ca-a64c-fa5579ae44fd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:19.920782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaef867-9080-40ca-a64c-fa5579ae44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:19.921117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaef867-9080-40ca-a64c-fa5579ae44fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:19.922541 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaef867-9080-40ca-a64c-fa5579ae44fd admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=b47636c54d4f488b8ee95139571f50ca, scope.project.id=1553b5a1fd044efd942a69ded741565d) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:19.922882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaef867-9080-40ca-a64c-fa5579ae44fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:19.925005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaef867-9080-40ca-a64c-fa5579ae44fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:19.933005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 190/380] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:19 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=b47636c54d4f488b8ee95139571f50ca => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:20.895198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389465e-ad8f-4a83-99b5-ae4236b8e546 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:20.895768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389465e-ad8f-4a83-99b5-ae4236b8e546 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:20.895854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389465e-ad8f-4a83-99b5-ae4236b8e546 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:20.897810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 191/381] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:20.904481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cdc08-1363-4dea-a5e7-bd27faf7c1ac None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:20.905014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cdc08-1363-4dea-a5e7-bd27faf7c1ac None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:20.905171 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cdc08-1363-4dea-a5e7-bd27faf7c1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:20.925149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-858cdc08-1363-4dea-a5e7-bd27faf7c1ac None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:20.926412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-858cdc08-1363-4dea-a5e7-bd27faf7c1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:20.934084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 191/382] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:20.958467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389465e-ad8f-4a83-99b5-ae4236b8e546 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:20.972332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389465e-ad8f-4a83-99b5-ae4236b8e546 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:20.976768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:20.977716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:20.977999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:20.978273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:20.990761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:20.998498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:21.000146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 192/383] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:21.006615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cdc08-1363-4dea-a5e7-bd27faf7c1ac None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.017663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cdc08-1363-4dea-a5e7-bd27faf7c1ac None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.023140 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.023827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.024103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.024373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.025145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:21.025498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.027096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.037183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 192/384] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:21.043989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.055382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73be4f-4c47-4206-8b6c-b1f9ac719697 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.059783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.060429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.060712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.060986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.069992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.072096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.082007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 193/385] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:21.088648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.099191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78f02d-2d53-47c6-9514-432a59158adf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.104131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.105060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.105396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.105768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.107122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.109394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.111151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 193/386] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:21.117922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.127892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4f1c-2984-4d1b-b6bc-aef41d7b655d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.133709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c2e70-398a-4352-b35d-09731ee53bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.134579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2e70-398a-4352-b35d-09731ee53bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.134857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2e70-398a-4352-b35d-09731ee53bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.135124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c2e70-398a-4352-b35d-09731ee53bd5 admin admin] PATH_INFO: `/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.136458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2e70-398a-4352-b35d-09731ee53bd5 admin admin] RBAC: Authorizing `identity:get_group(group_id=57ef098e1cd04c51bf6ca19faaf257c8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.138426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c2e70-398a-4352-b35d-09731ee53bd5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.140230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 194/387] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/groups/57ef098e1cd04c51bf6ca19faaf257c8 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:21.147022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.158019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574cf6f-266d-47a6-b783-cda22a917f5f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.163926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446fecc-a703-442f-b8f3-3908eb77a12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.164577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446fecc-a703-442f-b8f3-3908eb77a12e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.164833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446fecc-a703-442f-b8f3-3908eb77a12e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.165093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446fecc-a703-442f-b8f3-3908eb77a12e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.166003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446fecc-a703-442f-b8f3-3908eb77a12e admin admin] RBAC: Adding query filter params (group.id=57ef098e1cd04c51bf6ca19faaf257c8, role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=1553b5a1fd044efd942a69ded741565d) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:21.166312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446fecc-a703-442f-b8f3-3908eb77a12e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.168151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446fecc-a703-442f-b8f3-3908eb77a12e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.174834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 194/388] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/role_assignments?group.id=57ef098e1cd04c51bf6ca19faaf257c8&scope.project.id=1553b5a1fd044efd942a69ded741565d&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:21.511101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a99bb-920d-410c-b561-2f272edba585 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.511628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a99bb-920d-410c-b561-2f272edba585 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.512013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a99bb-920d-410c-b561-2f272edba585 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.514265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 195/389] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:21.524045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497010e-c523-45c4-854e-1c079810f982 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.524374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497010e-c523-45c4-854e-1c079810f982 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.524700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497010e-c523-45c4-854e-1c079810f982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.549055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a497010e-c523-45c4-854e-1c079810f982 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:21.550822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a497010e-c523-45c4-854e-1c079810f982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:21.560987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 195/390] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:21.594093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a99bb-920d-410c-b561-2f272edba585 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.609200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a99bb-920d-410c-b561-2f272edba585 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.614646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.615776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.616216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.616549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.629706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:21.638965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:21.640489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 196/391] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:21.648198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497010e-c523-45c4-854e-1c079810f982 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.657859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497010e-c523-45c4-854e-1c079810f982 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.662962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.663638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.663925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.664197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.664977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:21.665283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.666958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.676470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 196/392] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:21.682975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.693503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979031f-633d-46bc-9dc1-cd0c20795509 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.698847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.699560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.699896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.700219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.709666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.711513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.721246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 197/393] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:21.728139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.738915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e6e2f-f640-46ae-b0e5-9d0c37fbaa5f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.743958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.744885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.745216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.745574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] PATH_INFO: `/v3/projects/fb897d934c0d40faa98082f63fe4c388` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.746866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] RBAC: Authorizing `identity:get_project(project_id=fb897d934c0d40faa98082f63fe4c388)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.748779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.750952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 197/394] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/projects/fb897d934c0d40faa98082f63fe4c388 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:21.758299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.767866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf84a3f4-28d6-449b-b3ac-94995e2dbf1e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.772468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547896c8-34dc-4d77-9dbb-4dac5227409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.773387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547896c8-34dc-4d77-9dbb-4dac5227409d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.773769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547896c8-34dc-4d77-9dbb-4dac5227409d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.774054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547896c8-34dc-4d77-9dbb-4dac5227409d admin admin] PATH_INFO: `/v3/groups/1d7f0d9cbe164b7cbd94f4cbdf643226` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.775314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547896c8-34dc-4d77-9dbb-4dac5227409d admin admin] RBAC: Authorizing `identity:get_group(group_id=1d7f0d9cbe164b7cbd94f4cbdf643226)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.777370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547896c8-34dc-4d77-9dbb-4dac5227409d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.779112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 198/395] 10.222.0.31 () {56 vars in 1201 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/groups/1d7f0d9cbe164b7cbd94f4cbdf643226 => generated 229 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:21.786757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:21.797055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2119f-dc19-42d3-8efd-32401f1440fe admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:21.802036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fe8a3-ed63-4311-a314-10c43ec96368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:21.802848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe8a3-ed63-4311-a314-10c43ec96368 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:21.803182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe8a3-ed63-4311-a314-10c43ec96368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:21.803494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fe8a3-ed63-4311-a314-10c43ec96368 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:21.804407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fe8a3-ed63-4311-a314-10c43ec96368 admin admin] RBAC: Adding query filter params (group.id=1d7f0d9cbe164b7cbd94f4cbdf643226, role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=fb897d934c0d40faa98082f63fe4c388) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:21.804753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fe8a3-ed63-4311-a314-10c43ec96368 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:21.806853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fe8a3-ed63-4311-a314-10c43ec96368 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:21.814016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 198/396] 10.222.0.31 () {56 vars in 1397 bytes} [Tue Nov 16 03:04:21 2021] GET /identity/v3/role_assignments?group.id=1d7f0d9cbe164b7cbd94f4cbdf643226&scope.project.id=fb897d934c0d40faa98082f63fe4c388&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:25.432970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1a63-a530-43ba-8c50-83c50692ffed None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.433665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede8e4-38d7-40fd-95f8-6bb476a637b6 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.434004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1a63-a530-43ba-8c50-83c50692ffed None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.434088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede8e4-38d7-40fd-95f8-6bb476a637b6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.434159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b1a63-a530-43ba-8c50-83c50692ffed None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.434629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ede8e4-38d7-40fd-95f8-6bb476a637b6 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.438088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 199/397] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:25 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:25.438423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 199/398] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:25 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:25.450012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617397-78be-4ce2-abfd-20d6739af132 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.450495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617397-78be-4ce2-abfd-20d6739af132 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.450980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78617397-78be-4ce2-abfd-20d6739af132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.454083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707851-e504-4955-bf29-162b7d217b40 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.454477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707851-e504-4955-bf29-162b7d217b40 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.454907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707851-e504-4955-bf29-162b7d217b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.488247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9a707851-e504-4955-bf29-162b7d217b40 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:25.489670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9a707851-e504-4955-bf29-162b7d217b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:25.520070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 200/399] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:25.521772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-78617397-78be-4ce2-abfd-20d6739af132 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:25.523620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-78617397-78be-4ce2-abfd-20d6739af132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:25.545830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 200/400] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:25.572481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a707851-e504-4955-bf29-162b7d217b40 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:25.597713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a707851-e504-4955-bf29-162b7d217b40 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:25.611548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:25.612914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.613379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.613896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.640044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:25.643648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:25.676510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78617397-78be-4ce2-abfd-20d6739af132 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:25.691375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:25.693158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78617397-78be-4ce2-abfd-20d6739af132 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:25.694032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 201/401] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:25.704963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:25.718947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:25.720331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.720788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.721243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.729155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df89bc9-0580-4994-a067-98ff5c4acca6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:25.741130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:25.742175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.742646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.743099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.744168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:25.744681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:25.745942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:25.745942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:25.745942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:25.748008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:25.751251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:25.753389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:25.771492 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 202/402] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:25.781062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:25.797495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:25.799434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 201/403] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:25.803901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25802f8e-e022-43bb-8dfa-423c2d79a04d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:25.810882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:25.817457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4fc7c-0f73-4bd3-a503-b29b25581ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:25.817457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fc7c-0f73-4bd3-a503-b29b25581ccf admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.817457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fc7c-0f73-4bd3-a503-b29b25581ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.817457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4fc7c-0f73-4bd3-a503-b29b25581ccf admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.817861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4fc7c-0f73-4bd3-a503-b29b25581ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:25.817861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4fc7c-0f73-4bd3-a503-b29b25581ccf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:25.834670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72242750-0772-45ff-b525-472e27a96ca0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:25.840685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:25.841841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.842379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.842896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.844066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:25.845147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:25.847496 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:25.862842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 202/404] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:25.869568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 203/405] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:04:25 2021] POST /identity/v3/users => generated 246 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:04:25.872546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:25.886260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a265793-9b3a-420c-8dfe-ea5fd01d4674 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:25.891653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23955679-ffad-49ff-9c13-03382eaedb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:25.892691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23955679-ffad-49ff-9c13-03382eaedb75 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:25.893145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23955679-ffad-49ff-9c13-03382eaedb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:25.893628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23955679-ffad-49ff-9c13-03382eaedb75 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:25.894593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23955679-ffad-49ff-9c13-03382eaedb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:25.896896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23955679-ffad-49ff-9c13-03382eaedb75 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:25.927790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 203/406] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:04:25 2021] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:04:26.416337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe803ea-6491-4496-bd35-ca5be053e9ec None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.417220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe803ea-6491-4496-bd35-ca5be053e9ec None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.418025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe803ea-6491-4496-bd35-ca5be053e9ec None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.420461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 204/407] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:26.431082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fe2e-52ce-4d83-bc47-5fa961731574 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.431589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fe2e-52ce-4d83-bc47-5fa961731574 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.432116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85fe2e-52ce-4d83-bc47-5fa961731574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.457349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ba85fe2e-52ce-4d83-bc47-5fa961731574 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:26.459536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ba85fe2e-52ce-4d83-bc47-5fa961731574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:26.471520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 204/408] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:26.511508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a564a-437e-4424-ba4e-351abdff4d5c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.512069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a564a-437e-4424-ba4e-351abdff4d5c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.512432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a564a-437e-4424-ba4e-351abdff4d5c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.515228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85fe2e-52ce-4d83-bc47-5fa961731574 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:26.516833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 205/409] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:26 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:26.525392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85fe2e-52ce-4d83-bc47-5fa961731574 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:26.527981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7fb1-5ab4-431e-949c-b8b89d9803c5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.528607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7fb1-5ab4-431e-949c-b8b89d9803c5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.529200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc7fb1-5ab4-431e-949c-b8b89d9803c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.536813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:26.537930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.538437 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.538869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.554703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:26.556830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:26.576868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:26.578845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 205/410] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:26.579381 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-48bc7fb1-5ab4-431e-949c-b8b89d9803c5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:26.584607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-48bc7fb1-5ab4-431e-949c-b8b89d9803c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:26.588781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:26.597968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 206/411] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:26.609776 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104451f-f215-44fe-8bca-5c8316d67b5f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:26.619039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:26.619723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.619999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.620266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.621025 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:26.621330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:26.622994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:26.642310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 206/412] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:26.643574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7fb1-5ab4-431e-949c-b8b89d9803c5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:26.648625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:26.660299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236689b-d2c6-4aa0-9440-08fde77e7f68 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:26.672794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc7fb1-5ab4-431e-949c-b8b89d9803c5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:26.675938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:26.678843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.680767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.682219 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.684481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:26.688743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:26.690115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.690582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.691043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.693835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:26.718302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:26.721142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:26.740970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 207/413] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:04:26 2021] POST /identity/v3/users => generated 248 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:04:26.753682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:26.755470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 207/414] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:26.779198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:26.798172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81f43-dbb1-420a-913b-a30d751841c3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:26.820568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf661f-3bd2-4f94-88c1-227050afb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:26.821845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf661f-3bd2-4f94-88c1-227050afb2bf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.822352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf661f-3bd2-4f94-88c1-227050afb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.822837 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf661f-3bd2-4f94-88c1-227050afb2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.824332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf661f-3bd2-4f94-88c1-227050afb2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:26.824884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf661f-3bd2-4f94-88c1-227050afb2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:26.828212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf661f-3bd2-4f94-88c1-227050afb2bf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:26.868278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 208/415] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:26.878841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:26.891736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185540e-5495-4010-80eb-6e8c065bf08d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:26.907483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4763494-ebc9-41aa-84de-dea3fad45547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:26.908188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763494-ebc9-41aa-84de-dea3fad45547 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:26.908503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763494-ebc9-41aa-84de-dea3fad45547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:26.908733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4763494-ebc9-41aa-84de-dea3fad45547 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:26.909518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4763494-ebc9-41aa-84de-dea3fad45547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:26.911883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4763494-ebc9-41aa-84de-dea3fad45547 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:26.953095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 208/416] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:04:26 2021] POST /identity/v3/users => generated 249 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:04:27.262700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913020c9-b016-4a90-946b-e62d692dce84 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:27.263213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913020c9-b016-4a90-946b-e62d692dce84 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:27.263655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913020c9-b016-4a90-946b-e62d692dce84 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:27.268212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 209/417] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:27 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:27.275888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1383-dc02-4498-afd6-e0ba336db1c4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:27.276554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1383-dc02-4498-afd6-e0ba336db1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:27.277215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd1383-dc02-4498-afd6-e0ba336db1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:27.315861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-addd1383-dc02-4498-afd6-e0ba336db1c4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:27.317994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-addd1383-dc02-4498-afd6-e0ba336db1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:27.334952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 209/418] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:27.361647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913020c9-b016-4a90-946b-e62d692dce84 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:27.387755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913020c9-b016-4a90-946b-e62d692dce84 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:27.395704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:27.396850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:27.397346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:27.397879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:27.399339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:27.402448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:27.420442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.sql.core [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 16 03:04:27.420442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 16 03:04:27.420442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [parameters: {'id': 'f565b1e3dc274af58c658716acc46642', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 16 03:04:27.420442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 16 03:04:27.448623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 16 03:04:27.451842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 210/419] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:04:27 2021] POST /identity/v3/roles => generated 144 bytes in 91 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:27.459043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd1383-dc02-4498-afd6-e0ba336db1c4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:27.476826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd1383-dc02-4498-afd6-e0ba336db1c4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:27.490142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cffbf9-8865-4c51-9322-a4718cc736e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:27.491564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffbf9-8865-4c51-9322-a4718cc736e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:27.492126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffbf9-8865-4c51-9322-a4718cc736e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:27.492612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffbf9-8865-4c51-9322-a4718cc736e2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:27.518737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cffbf9-8865-4c51-9322-a4718cc736e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:27.534134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e7cffbf9-8865-4c51-9322-a4718cc736e2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 16 03:04:27.537247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 210/420] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:04:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:27.546858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:27.574492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878acfb5-5b82-45f2-8c04-69a8f07bec11 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:27.587897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b132b-590a-48c7-93bb-f10c2269a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:27.589396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b132b-590a-48c7-93bb-f10c2269a9db admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:27.590232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b132b-590a-48c7-93bb-f10c2269a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:27.590889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b132b-590a-48c7-93bb-f10c2269a9db admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:27.592398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b132b-590a-48c7-93bb-f10c2269a9db admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:27.593202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b132b-590a-48c7-93bb-f10c2269a9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:27.596317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b132b-590a-48c7-93bb-f10c2269a9db admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:27.623038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 211/421] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:29.390632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532e2a-771d-414a-8841-14896dda2387 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.391783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532e2a-771d-414a-8841-14896dda2387 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.392376 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09532e2a-771d-414a-8841-14896dda2387 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.395086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 211/422] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:29 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:29.403003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bd929-b827-4903-a000-451e741d4bd5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.404104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bd929-b827-4903-a000-451e741d4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.404622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bd929-b827-4903-a000-451e741d4bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.434812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-559bd929-b827-4903-a000-451e741d4bd5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:29.436620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-559bd929-b827-4903-a000-451e741d4bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:29.450220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 212/423] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:29.475919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532e2a-771d-414a-8841-14896dda2387 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:29.496599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09532e2a-771d-414a-8841-14896dda2387 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:29.508509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:29.509826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.510373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.510907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.528922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:29.537122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:29.544669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 212/424] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:29.546703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bd929-b827-4903-a000-451e741d4bd5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:29.563859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bd929-b827-4903-a000-451e741d4bd5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:29.575941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:29.577030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.577662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.578194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.579320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:29.579867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:29.581812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:29.599346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 213/425] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:29.606503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:29.623298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132b101-8227-4bd4-9ec5-2a7fc14faf0a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:29.631878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:29.633126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.633666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.634146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.650618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:29.652871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:29.675228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:29.676899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 213/426] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:29.684759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:29.713686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e068e3-6d0a-4cde-8a78-686d86b66f3e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:29.724123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:29.724807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.725083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.725353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.726136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:29.726436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:29.728066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:29.752630 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 214/427] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:29.759921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:29.774917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56117821-3079-48e6-96c4-f7f048d407f2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:29.786677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:29.788097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.788755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.789469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.810977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:29.813638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:29.833486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:04:29.840253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 214/428] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:04:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:29.841721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:29.857122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55d3c0-746b-4fb6-8434-87cec48820df admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:29.870209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:29.871260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.871759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.872232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.873372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:29.873925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:29.875256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:29.875256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:29.875256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:29.876832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:29.930507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 215/429] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:04:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:29.937296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:29.956042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1d86-7bc4-49ad-a813-a7fd5f890019 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:29.970273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692bd6-b8e8-4feb-927d-95704fb3dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:29.970992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692bd6-b8e8-4feb-927d-95704fb3dc47 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:29.971280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692bd6-b8e8-4feb-927d-95704fb3dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:29.971560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692bd6-b8e8-4feb-927d-95704fb3dc47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:29.981304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19692bd6-b8e8-4feb-927d-95704fb3dc47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:29.983512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19692bd6-b8e8-4feb-927d-95704fb3dc47 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:29.997936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 215/430] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:29 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:30.005976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.030522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c59a59-4e81-4586-803c-681c654e08aa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.044143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.045641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.046257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.046724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.079425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.083041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.093535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fcd03-1073-4e92-8807-e45623ad8478 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.094167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fcd03-1073-4e92-8807-e45623ad8478 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.094630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fcd03-1073-4e92-8807-e45623ad8478 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.096664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 216/431] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:30.113714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27ff4-dd13-4ae8-a3e1-990222abbb61 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.114393 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27ff4-dd13-4ae8-a3e1-990222abbb61 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.114879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d27ff4-dd13-4ae8-a3e1-990222abbb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.122388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:30.133841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 216/432] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:30.137212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.152175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-38d27ff4-dd13-4ae8-a3e1-990222abbb61 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:30.154054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-38d27ff4-dd13-4ae8-a3e1-990222abbb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:30.156526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb474e-743a-471d-b52a-2369fac4eced admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.168920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.170079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.170566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.171094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.172418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:30.172956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.177411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 217/433] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:30.180437 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.206189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 217/434] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:30.215626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d27ff4-dd13-4ae8-a3e1-990222abbb61 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.228664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.240042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d27ff4-dd13-4ae8-a3e1-990222abbb61 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.251174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720571d-3fef-4108-91fc-10a92504d4fb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.255726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.256565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.256839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.257120 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.259385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.260962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.261479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.262014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.274755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.276802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.282543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:30.297316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:30.299934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 218/435] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:30.304682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:30.307251 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 218/436] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:30.309274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.316590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.338832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea522060-9da1-48c1-86e5-76a676df017e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.350949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc155a-eb89-49b4-9246-3dd81bc64715 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.355246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.356473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.357674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.358135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.359810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:30.360327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.363440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.363685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.364768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.365201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.365716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.367136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:30.367626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.369545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:30.369545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:30.369545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:30.371654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.379741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 219/437] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:30.392586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.406507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 219/438] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:30.414843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.419029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a17d89-3bb8-455a-bf7a-52ddb4609b9e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.438621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.440277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.442967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.443449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.445845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117019c3-aad5-40d8-bb05-c5f2ee429f8b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.463422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.466910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.467392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.468656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.474196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=cf258dbbf82147618bc5310aebd91a65) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:30.474762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.481606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.485798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.489354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.496766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 220/439] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/role_assignments?user.id=cf258dbbf82147618bc5310aebd91a65&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 259 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:30.526663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:30.529309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 220/440] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:30.539122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.564212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d9c16-ab1c-4292-91e8-47c35cef5c8d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.575047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.576276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.576774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.578191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.579710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:30.580255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.583585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.620205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 221/441] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:30.630913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.654018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3691-0e1c-4271-8b02-ffe5226ab030 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.667201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.668668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.669163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.669726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.687943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.696169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.731339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 16 03:04:30.733305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 221/442] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/users/glance => generated 84 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:30.745314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.764467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f291d-e296-4bea-bdca-3e105f7bab66 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.772579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.773877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.774437 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.774903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.776640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:30.777301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.779248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:30.779248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:30.779248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:30.781629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.885615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 222/443] 10.222.0.31 () {56 vars in 1158 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:30.895075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.915604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519909fb-924a-4333-a4f2-bf6ef759a4cd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:30.927881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:30.928567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:30.928854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:30.929132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:30.942036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:30.943915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:30.959952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 222/444] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:30.970459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:30.998970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc7eb8-3259-4d7f-9a10-3b5013cb001a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.011086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f09827-2355-46c1-9748-ba65ab4d5fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.012363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09827-2355-46c1-9748-ba65ab4d5fbc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.012852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09827-2355-46c1-9748-ba65ab4d5fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.013334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f09827-2355-46c1-9748-ba65ab4d5fbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.040694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f09827-2355-46c1-9748-ba65ab4d5fbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.044302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f09827-2355-46c1-9748-ba65ab4d5fbc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.090191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-54f09827-2355-46c1-9748-ba65ab4d5fbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:31.092385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 223/445] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:31.102778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.117079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6887-c5bc-4721-bef2-e4bec7cd1544 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.117568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6887-c5bc-4721-bef2-e4bec7cd1544 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.118018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6887-c5bc-4721-bef2-e4bec7cd1544 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.119760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117ecc8-e4da-45b1-ab30-b78f4b946a15 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.121645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 224/446] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:31.131019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40875b-13be-41a7-85c2-ce0abad138a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.131706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40875b-13be-41a7-85c2-ce0abad138a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.131986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40875b-13be-41a7-85c2-ce0abad138a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.132235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6cf36-1e5a-4ad1-9916-37dc4ce1661e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.132464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40875b-13be-41a7-85c2-ce0abad138a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.132687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6cf36-1e5a-4ad1-9916-37dc4ce1661e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.132997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40875b-13be-41a7-85c2-ce0abad138a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.133229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6cf36-1e5a-4ad1-9916-37dc4ce1661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.133502 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40875b-13be-41a7-85c2-ce0abad138a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.134961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40875b-13be-41a7-85c2-ce0abad138a8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.163543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 223/447] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:31.165130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb142fb-4d16-4097-807e-489e7c5bb771 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.165414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb142fb-4d16-4097-807e-489e7c5bb771 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.165719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb142fb-4d16-4097-807e-489e7c5bb771 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.170662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 224/448] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:31.173327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d0b6cf36-1e5a-4ad1-9916-37dc4ce1661e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:31.175408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d0b6cf36-1e5a-4ad1-9916-37dc4ce1661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:31.176638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb142fb-4d16-4097-807e-489e7c5bb771 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.192384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 225/449] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:31.194686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb142fb-4d16-4097-807e-489e7c5bb771 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.194801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59259b-8760-461f-a2d4-0517d38752fc None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.194801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59259b-8760-461f-a2d4-0517d38752fc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.194801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59259b-8760-461f-a2d4-0517d38752fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.201309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.203524 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.204202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.204686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.218079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.222003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.228522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1b59259b-8760-461f-a2d4-0517d38752fc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:31.230672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1b59259b-8760-461f-a2d4-0517d38752fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:31.244702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 226/450] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:31.249725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:31.252046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 225/451] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:31.261275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59259b-8760-461f-a2d4-0517d38752fc None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.261484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.277650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59259b-8760-461f-a2d4-0517d38752fc None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.279751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a0f07-2287-4b46-86f9-67805b46c894 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.284944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.285213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.286600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.286940 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.287042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.287398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.287764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.288255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.288628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.289151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.292808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.302736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:31.311830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:31.313984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 226/452] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:31.314980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.324047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 227/453] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:31.327525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4aaa1-fed3-4269-802d-d5dff7f5b8d3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.328193 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.332892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.334428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.334935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.335410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.346096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917869bb-6a71-40e6-85fa-690863ac6298 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.351949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:31.354250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.355685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.356238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.356758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.358495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.359094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.360879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:31.362493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.368209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 227/454] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:31.368209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.381040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5795c-0b29-4a97-8513-59a82b4a3220 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.382026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 228/455] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:31.383483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.386947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.387933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.388413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.388951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.390193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=c3fd595065064131926ed83613a82ffc) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.390749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.392884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.400148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 228/456] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/role_assignments?user.id=c3fd595065064131926ed83613a82ffc&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:31.401669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.410280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638399d5-4fe2-4175-bcab-2eef05680e8b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.414507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb95613-8396-4455-9158-1715915c6765 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.418539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.419759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.420057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.420502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.420903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.421775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.422320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.422480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.422945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.423046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.426596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.437418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.440084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.449479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 229/457] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:31.457755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.473529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:31.475212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 229/458] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:31.489000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.497539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ff6ca-365e-4cd9-9310-ab2e335b3438 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.510753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d2dc-c628-4ac2-9cc4-f67751a17beb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.511847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.513011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.514546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.515255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.525124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.526267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.527371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.528687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.529762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.531221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.536519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.545512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.550480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.571593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 230/459] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:31.579021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.595365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a9cea-4287-438f-8893-9ac2ccfdb956 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.597965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:31.605779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 230/460] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:31.610521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.611807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.612289 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.612799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.622351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.625037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.628183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.639890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eed97-3ebb-4cfc-b6eb-c53e39b80a5d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.652971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.654167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.654733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.655223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.658019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.658719 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.660759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.673024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 03:04:31.678317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 231/461] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:31.687795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.694453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 231/462] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:31.706483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd322-b5d3-4b2c-bdb8-a277ec4d92d8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.709137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.724842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26251abf-28c1-4e27-9de8-3451d014a545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.726018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26251abf-28c1-4e27-9de8-3451d014a545 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.726785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77ed74-2c55-4dde-b1bd-297c0c0b6471 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.727323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26251abf-28c1-4e27-9de8-3451d014a545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.728217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26251abf-28c1-4e27-9de8-3451d014a545 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.730095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26251abf-28c1-4e27-9de8-3451d014a545 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.731193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26251abf-28c1-4e27-9de8-3451d014a545 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.736499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26251abf-28c1-4e27-9de8-3451d014a545 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.740223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7f9f-1cd8-4efc-a8e8-a6a933a0bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.742377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7f9f-1cd8-4efc-a8e8-a6a933a0bd9b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.744405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7f9f-1cd8-4efc-a8e8-a6a933a0bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.746443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7f9f-1cd8-4efc-a8e8-a6a933a0bd9b admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.773477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 232/463] 10.222.0.31 () {56 vars in 1158 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:31.774667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7f9f-1cd8-4efc-a8e8-a6a933a0bd9b admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.775919 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d859-b97f-465b-b381-bd5939594bb4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.776276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d859-b97f-465b-b381-bd5939594bb4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.776620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d859-b97f-465b-b381-bd5939594bb4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.779277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 233/464] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:31 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:31.780964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7f9f-1cd8-4efc-a8e8-a6a933a0bd9b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.789105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715d859-b97f-465b-b381-bd5939594bb4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.809490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715d859-b97f-465b-b381-bd5939594bb4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.814901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-709b7f9f-1cd8-4efc-a8e8-a6a933a0bd9b admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 16 03:04:31.815428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.816775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.817512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.818189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.819549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 232/465] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:31.822228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed165-7cb2-4daa-97ec-ced41f8251b9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.831606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.832252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed165-7cb2-4daa-97ec-ced41f8251b9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.832895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ed165-7cb2-4daa-97ec-ced41f8251b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.833925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.853500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 234/466] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:31.853500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.857369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a0148-192d-4435-b5a7-11826e38e91e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.862592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.863460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.863847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.864225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.865221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:31.866397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.867975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.878310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e00ed165-7cb2-4daa-97ec-ced41f8251b9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:31.880742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e00ed165-7cb2-4daa-97ec-ced41f8251b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:31.889197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 235/467] 10.222.0.31 () {56 vars in 1160 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:31.895106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.900136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 233/468] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:31.903044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed165-7cb2-4daa-97ec-ced41f8251b9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.932053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ed165-7cb2-4daa-97ec-ced41f8251b9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.933018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c656a-9f71-4977-be71-36d6489facb2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:31.937701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.938662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.939098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.939530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.941567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:31.943100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:31.943786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:31.944436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:31.954784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.956915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.967260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:31.972924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:31.974265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 234/469] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:31.975910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:31.993300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5073319-8a05-400a-8f5a-f6b09b931db5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.001760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.003636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.004401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.005169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.015647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:32.017728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 236/470] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:32.020011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.025219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.029121 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.039460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802a5fd-a675-4e4c-8d00-e450c974aeb8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.049640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.050920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.051389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.051860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.064806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:32.067484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 235/471] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:32.069355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.071108 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.074529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.086912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1716647-7036-4a68-916e-817e7c48a49c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.095591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.097240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.098083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.098844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.100438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:32.101217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.104541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.111234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:32.117554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 237/472] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:32.119486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.135250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 236/473] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:32.137204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.143143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd30c-d2ff-46f2-9f50-1b7580a684f3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.153408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.155969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648f163-03da-4ca0-ab67-2893f4990a18 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.156609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.157126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.157615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.160031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:32.160562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.168533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.176046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.178010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.178793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.179650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.181292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:32.182184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.185634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.196373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 238/474] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:32.198035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.211000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 237/475] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:32.213213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.225796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89490040-539f-4ca1-92d8-1fbade22516e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.232989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c786b68-ad45-4259-aafc-09a133aebe17 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.236822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.238636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.239179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.239731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.242307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.243646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.244344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.245061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.246593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.250578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.253525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.257044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.283026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:32.284929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 239/476] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:32.286745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.288356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 238/477] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:04:32 2021] POST /identity/v3/users => generated 247 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:04:32.298814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.304963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd4349-bb97-4cff-b522-b34e403768b1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.313682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.315213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.316748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.316748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.324210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e22ee03-566f-404a-9d99-61ea18b9751e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.332203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.333949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.334810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.335534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.337377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:32.338267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.342486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.342754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.346705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.370596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 239/478] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:32.381795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.384612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:32.386812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 240/479] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:32.398396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.412817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9be88-d07d-4282-9aef-38caae245c2f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.426338 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7da1f-543b-4052-843a-359109e895a0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.431866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.433734 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.435827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.436339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.439881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=2904526cac37478bb9fd712ac29f86f8) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:32.440782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.442482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.444469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.444928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.445378 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.448757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:32.449255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.450163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.453926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:32.453926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:32.453926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:32.459819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3439dcc-7371-454d-9dd0-d403fec0fd6e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.470182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 240/480] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/role_assignments?user.id=2904526cac37478bb9fd712ac29f86f8&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 259 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:32.505572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 241/481] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:32.510319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:32.533281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bb841-efab-4d81-b081-fe5dfc540dec admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:32.542990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0eb6ba-8da4-451b-b6c0-7c99cb4e2b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:32.544156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0eb6ba-8da4-451b-b6c0-7c99cb4e2b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:32.544689 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0eb6ba-8da4-451b-b6c0-7c99cb4e2b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:32.545144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0eb6ba-8da4-451b-b6c0-7c99cb4e2b2b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:32.546865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0eb6ba-8da4-451b-b6c0-7c99cb4e2b2b admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=6d09511f0bb7411f9f8c06f49d3a5810) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:32.547377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0eb6ba-8da4-451b-b6c0-7c99cb4e2b2b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:32.550840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0eb6ba-8da4-451b-b6c0-7c99cb4e2b2b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:32.564551 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 241/482] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:32 2021] GET /identity/v3/role_assignments?user.id=6d09511f0bb7411f9f8c06f49d3a5810&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:34.717095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9280c-609b-4c35-beb1-95862fb8b693 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:34.718019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9280c-609b-4c35-beb1-95862fb8b693 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:34.718194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9280c-609b-4c35-beb1-95862fb8b693 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:34.722095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 242/483] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:34 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:34.732440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9dfd-2768-4311-b943-55ccec2559f7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:34.733300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9dfd-2768-4311-b943-55ccec2559f7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:34.733497 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9dfd-2768-4311-b943-55ccec2559f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:34.773811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a1dc9dfd-2768-4311-b943-55ccec2559f7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:34.775834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a1dc9dfd-2768-4311-b943-55ccec2559f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:34.798802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 242/484] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:34.859279 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9280c-609b-4c35-beb1-95862fb8b693 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:34.890612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9280c-609b-4c35-beb1-95862fb8b693 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:34.902815 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:34.904235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:34.904723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:34.905238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:34.939370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:34.953950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:34.956218 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 243/485] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:34.967771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc9dfd-2768-4311-b943-55ccec2559f7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:34.989900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc9dfd-2768-4311-b943-55ccec2559f7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.001382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cd955-e8ff-4d12-8a4d-3f84ae9ae77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.002556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cd955-e8ff-4d12-8a4d-3f84ae9ae77d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.003039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cd955-e8ff-4d12-8a4d-3f84ae9ae77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.003522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cd955-e8ff-4d12-8a4d-3f84ae9ae77d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.004932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cd955-e8ff-4d12-8a4d-3f84ae9ae77d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.005511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cd955-e8ff-4d12-8a4d-3f84ae9ae77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.008635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cd955-e8ff-4d12-8a4d-3f84ae9ae77d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.032385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 243/486] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:35.041995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.061848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af85bb3-af94-4de7-a1f1-2ff2bcff089a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.075429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.076705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.077673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.078102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.109352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3674e-6523-45f2-9cf4-005b3f9f49f2 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.110053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3674e-6523-45f2-9cf4-005b3f9f49f2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.110528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3674e-6523-45f2-9cf4-005b3f9f49f2 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.113829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 244/487] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:35 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:35.121495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.123710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c2d30-59e2-41b6-ac07-5d9e92cb21da None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.124818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c2d30-59e2-41b6-ac07-5d9e92cb21da None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.125289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c2d30-59e2-41b6-ac07-5d9e92cb21da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.126251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.158922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:35.162412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 244/488] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:35.174091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.188518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6b9c2d30-59e2-41b6-ac07-5d9e92cb21da None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:35.191176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6b9c2d30-59e2-41b6-ac07-5d9e92cb21da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:35.205210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f601fb6-6f0d-4771-92e8-4576031be1e3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.220174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 245/489] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:35.228007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.229580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.230371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.231122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.232745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.233668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.237109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.245509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c2d30-59e2-41b6-ac07-5d9e92cb21da None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.257341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c2d30-59e2-41b6-ac07-5d9e92cb21da None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.275315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.276715 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.277220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.277737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.287320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 245/490] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:35.299211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.320099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:35.336091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d313-f5cd-4a9d-a6ec-eb979173cd54 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.343388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:35.348243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 246/491] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:35.354814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.355654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.357042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.357753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.358250 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.367373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f74f8-e4a6-4b02-b6b5-20d568b0db9e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.376327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.378326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.379005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.379281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.379555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.380407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.380715 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.382094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.382351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.392755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 247/492] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:35.404355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.428327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7705f0-8e6d-45ba-910e-cdd383ad6184 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.429329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:04:35.431567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 246/493] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:35.441899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.442341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.443194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.443515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.443749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.460176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e27b764-d749-423d-a813-e38c6b822090 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.468558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.470670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.472064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.473235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.473774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.474256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.475925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.476463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.480381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.509181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:35.511798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 248/494] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:35.514778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 247/495] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:35.518402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.524673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.542409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f855a934-aa9a-46f0-aecf-d18d88c10700 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.549944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3865-1c64-4e9d-87bf-8d06a5ba01ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.550492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.551345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.551823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.552298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.571354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.573315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.574812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.575292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.576650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.579762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.586549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.594297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.599596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.629670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 249/496] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:35.636363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.661634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e274a-8e36-41a4-a24e-8a59f3fabc11 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.664098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:35.666697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 248/497] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:35.676765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.679242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.680067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.680320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.680592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.694117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.695468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a7158-28a1-4e44-a9b0-066fecfc9350 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.696177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.713483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.716310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.716804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.717299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.721657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.722088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.724628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.753523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 16 03:04:35.762522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 250/498] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/users/glance => generated 84 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:35.770251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 249/499] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:35.771232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.776624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.797070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035e6d-3724-4fd2-8418-cf5111d0837c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.801832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680d95a-65d8-4929-b0de-d0331414e918 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.814387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.815855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.816490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.817044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.826745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.827965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.828443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.828938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.830625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.831172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.834846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.857367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.864390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:35.906077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 251/500] 10.222.0.31 () {56 vars in 1158 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:35.909114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:35.913266 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.914046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 250/501] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:35.926235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:35.946538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19db3-726d-4d3c-b4b6-fa53d1362557 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.949846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514cb1c-2c5e-4e65-a1ac-18ca8a6ada00 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:35.960498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.962888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.964173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.965316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.969084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:35.970902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:35.973843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:35.976854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:35.977947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:35.979110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:35.980127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.026272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:36.030377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.035120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 251/502] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:36.047726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.065143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:36.066656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bafe3-7bad-49b6-b518-f69d4993849d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.072413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 252/503] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:36.081752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.088422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.094399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.095503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.096330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/cf258dbbf82147618bc5310aebd91a65/roles/b984563875e9456592cc79cc4869741d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.124895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c900e23b-fd9c-4318-9956-1b09638b49ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.146763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.147922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.148459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.148884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.150457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:36.151018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:36.153158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=cf258dbbf82147618bc5310aebd91a65, role_id=b984563875e9456592cc79cc4869741d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:36.154388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.159547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.198201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 252/504] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:36 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/cf258dbbf82147618bc5310aebd91a65/roles/b984563875e9456592cc79cc4869741d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:36.202386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 253/505] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:36.210347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.395611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc2e91-f61b-4142-ae70-9e80194cc35d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.408564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d0bca-6cfd-4da9-bd1c-a9fd3a8914a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.410000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d0bca-6cfd-4da9-bd1c-a9fd3a8914a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.410500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d0bca-6cfd-4da9-bd1c-a9fd3a8914a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.411354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d0bca-6cfd-4da9-bd1c-a9fd3a8914a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.431718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d0bca-6cfd-4da9-bd1c-a9fd3a8914a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:36.435954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d0bca-6cfd-4da9-bd1c-a9fd3a8914a2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.471913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f08d0bca-6cfd-4da9-bd1c-a9fd3a8914a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:36.474668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 253/506] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:36.483353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.507704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b77e55-2b22-4d88-bc33-411687662529 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.526154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.527342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.527835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.528321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.530018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:36.530644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:36.534397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.557742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3d42-4167-4e49-9d75-a9fe7d25cb4f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.558226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3d42-4167-4e49-9d75-a9fe7d25cb4f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.558708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b3d42-4167-4e49-9d75-a9fe7d25cb4f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.563004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 254/507] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:36 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:36.568007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 254/508] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:36.573929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870bd68-31c5-4b37-b677-d942cbcfcf49 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.574311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870bd68-31c5-4b37-b677-d942cbcfcf49 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.574460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870bd68-31c5-4b37-b677-d942cbcfcf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.579428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.599369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7825f72-6127-441d-b628-c03941ac4da2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.609208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f65ce-e094-4e6b-9fc6-365b6f2c059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.610662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f65ce-e094-4e6b-9fc6-365b6f2c059a admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.611119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f65ce-e094-4e6b-9fc6-365b6f2c059a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.611591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f65ce-e094-4e6b-9fc6-365b6f2c059a admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/c3fd595065064131926ed83613a82ffc/roles/b984563875e9456592cc79cc4869741d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.614183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1870bd68-31c5-4b37-b677-d942cbcfcf49 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:36.616509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1870bd68-31c5-4b37-b677-d942cbcfcf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:36.639013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f65ce-e094-4e6b-9fc6-365b6f2c059a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=c3fd595065064131926ed83613a82ffc, role_id=b984563875e9456592cc79cc4869741d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:36.641596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f65ce-e094-4e6b-9fc6-365b6f2c059a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.653673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 255/509] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:36.665372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 255/510] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:36 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/c3fd595065064131926ed83613a82ffc/roles/b984563875e9456592cc79cc4869741d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:36.700334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870bd68-31c5-4b37-b677-d942cbcfcf49 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.719326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870bd68-31c5-4b37-b677-d942cbcfcf49 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.838168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.839597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.840090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.840582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.862512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:36.876627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:36.880921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c7d9-751a-415c-b9df-a19281be2e3b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.881985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c7d9-751a-415c-b9df-a19281be2e3b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.882491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9c7d9-751a-415c-b9df-a19281be2e3b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.885074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 256/512] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:36.885258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 256/512] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:36 2021] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:36.892211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.895843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222bd5e-e18c-476b-9249-a3000aeee260 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.896547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222bd5e-e18c-476b-9249-a3000aeee260 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.897137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222bd5e-e18c-476b-9249-a3000aeee260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.911775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad648fc-e3ab-4e91-9421-ba94e02247f0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.921653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.921653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.921653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.921653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.922189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:36.922189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:36.924010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:36.934747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0222bd5e-e18c-476b-9249-a3000aeee260 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:36.936522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0222bd5e-e18c-476b-9249-a3000aeee260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:36.945753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 257/513] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:36 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:36.953379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:36.956801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 257/514] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:36.958625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151261-9300-4f56-a414-0d8aee94e5d3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.959123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151261-9300-4f56-a414-0d8aee94e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.959594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1151261-9300-4f56-a414-0d8aee94e5d3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.962112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 258/515] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:36.969913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efac88-6b2d-4e33-9f0f-0dba7c9b7d7c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.970518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efac88-6b2d-4e33-9f0f-0dba7c9b7d7c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.970987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efac88-6b2d-4e33-9f0f-0dba7c9b7d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.974190 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f96e0-562d-4b01-a43c-c4078449ae20 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:36.982178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:36.983619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:36.984095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:36.984590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:36.999819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e8efac88-6b2d-4e33-9f0f-0dba7c9b7d7c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:37.003633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e8efac88-6b2d-4e33-9f0f-0dba7c9b7d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:37.004247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.008437 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.019830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 259/516] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:37.021854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efac88-6b2d-4e33-9f0f-0dba7c9b7d7c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.041116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efac88-6b2d-4e33-9f0f-0dba7c9b7d7c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.045297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:37.047664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 258/517] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.049360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.051063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.051767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.052426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.055032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.073788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4afaf-ab2b-4dae-ab0b-652d7d858d43 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.074481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:37.082032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.083488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.083998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.084539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.090354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:37.092870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 260/518] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.095081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.105909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:37.114089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d6382-4926-4a01-b723-b686cb9e1cea admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.120624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:37.122549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.123491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 259/519] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.124191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.124892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.125179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.125827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.127214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.127767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.130957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.146221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01837081-6c19-4b1d-a486-13d842ad3891 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.154570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.155920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 261/520] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.156408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.157223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.157416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.158179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.159862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.160646 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.164737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.176282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2870a-7fe1-482e-a924-2c3832a05121 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.182272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 260/521] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.184225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.184400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.185419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.185945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.186518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.187873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.188483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.191570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.204555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeb203-65d6-4094-9f42-bf83a7240a31 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.209811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 262/522] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.211210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.213505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.215256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.216094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.216791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.230752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3595edb-2e82-4d40-876a-b3a39c20cb16 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.232434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.237062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.238816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.240250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.240742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.241595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.263434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.266925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 03:04:37.267092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.268947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 261/523] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/users/swift => generated 83 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.270264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.289609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3384120-2e79-4e37-b46c-e78acd21e47a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.298013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.299668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.300341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.301092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.305768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:37.308967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 263/524] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.310421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.325044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.328692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.336543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5208b7-8e37-46a3-ab8c-dc7820b5ea4b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.346215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.348287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.349078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.349897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.351807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.352635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.356635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.363220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:37.365595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 262/525] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.367213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.385556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf555-b10b-4d8d-955f-e78b2aa49a24 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.393463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.394598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.395092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.395505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.396678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.397128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.399830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.400846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 264/526] 10.222.0.31 () {56 vars in 1156 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.403036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.422746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 263/527] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.424265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.426020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a752cfb-8750-491c-adc1-380c077aff73 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.434193 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.436674 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.437614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.438789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.440567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.441407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.442499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b9498-be29-4838-b21a-5674b11df200 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.445316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.450647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.451743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.452273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.452817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.469096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.472022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 265/528] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.472789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.474185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.490730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 264/529] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:37.492209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.495026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe93b62-a22d-49d3-ac77-0047e80f4fde admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.504338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.506619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.507410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.508196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.509631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb7b65-2d94-4a1b-917a-57ef40d739ff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.516743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.517982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.518439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.518823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.527285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.532521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.533127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.537891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.563478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 16 03:04:37.564910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 03:04:37.566461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 266/530] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/users/neutron => generated 85 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.567416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 265/531] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/users/cinder => generated 84 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.568658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.579106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.586770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053f669-c976-4114-8b02-4408bc4b274c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.596217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.597652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.598153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.598643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.600965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9d40b-db6a-4c16-bbf3-616bba31180f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.609545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.611176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.611994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.612829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.614820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.615733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.619676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.620994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.625096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.657309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 266/532] 10.222.0.31 () {56 vars in 1160 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.659394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.662526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:37.664802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 267/533] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.666351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.680167 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c2e34-2113-43d1-915b-c0ac835c9757 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.686352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb565bf-6f1d-4f00-9cc3-2f829040c089 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.689110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.690778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.691604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.692361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.694025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.694779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.695399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.695902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.696314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.696464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.700746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.723566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.727584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.749998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 267/534] 10.222.0.31 () {56 vars in 1158 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.752721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.763056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:37.766650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 268/535] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.768595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.772490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d243ab-3cb3-4ba6-8135-a46f9865df18 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.781920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.783042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.783492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.783939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.786204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.786732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.789855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0acf8c-68fd-4dd0-8312-6c00b815c86d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.790088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.798623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.800572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.801535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.802369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.821175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 268/536] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.825969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.837192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.841359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.849661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc5f29-01ae-452f-ac2c-8f184ebe37c8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.856998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.858611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.859361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.860063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.861812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.862582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.865975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.880609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:37.883124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 269/537] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.884649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.893497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 269/538] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.895404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.904304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6662c49-add5-4acb-895b-44515b811414 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.914024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.915438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee8a51-3546-4ff2-b101-0f1c4c4dbffd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.915784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.916444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.917081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.923879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.924932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.925355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.925793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.926736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:37.927225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.929148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.933672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.937816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.944680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 270/539] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:37.946010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.958000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f67f6-ffb5-42fc-8166-106670977648 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.963159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:37.964179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:37.964645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:37.965052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:37.971140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:37.974033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 270/540] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.975096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:37.975596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:37.977526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:37.994414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:37.996269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 271/541] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:37.996387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b9ae7-8f1c-4e50-ae0b-b1fa631cab47 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:37.997548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:38.004455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:38.006489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:38.006933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:38.007333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:38.013312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebec6f9-21f7-4832-86a3-e074a136b809 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:38.022392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:38.024857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:38.025969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:38.026719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:38.027448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:38.028139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:38.030108 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:38.031288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:38.034945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:38.052039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:38.054305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 271/542] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:38.055768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:38.058335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 272/543] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:38.068320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:38.071003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348f082-6bbe-4c58-b247-b74028bfee7d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:38.075667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:38.076578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:38.077092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:38.077611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:38.078810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:38.079265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:38.081307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:38.088426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e5471-94ad-40ec-b17d-9f2dd6c166ad admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:38.101021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 272/544] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:38.102245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:38.102553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:38.103914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:38.104636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:38.105222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:38.107057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=b580550112ae4c51a3bffea61ede5bb2) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:38.107928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:38.113662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:38.114166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7476e-8dce-4cd4-a46e-7809eaf0f1f0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:38.119117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:38.120059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:38.120527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:38.120846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:38.121735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:38.122086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:38.124185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:38.128228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 273/545] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:38 2021] GET /identity/v3/role_assignments?user.id=b580550112ae4c51a3bffea61ede5bb2&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 259 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:38.130060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:38.149824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 273/546] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:38.150655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c67493-d954-457e-ac13-ddcab960ce8e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:38.156832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:38.159713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6018e-3cc7-4f5c-bc61-4f1705ff0e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:38.162060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6018e-3cc7-4f5c-bc61-4f1705ff0e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:38.162836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6018e-3cc7-4f5c-bc61-4f1705ff0e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:38.163897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6018e-3cc7-4f5c-bc61-4f1705ff0e53 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/6d09511f0bb7411f9f8c06f49d3a5810/roles/b984563875e9456592cc79cc4869741d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:38.180247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fc7fe-3476-4174-9678-a09c54ce14dc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:38.197187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6018e-3cc7-4f5c-bc61-4f1705ff0e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=6d09511f0bb7411f9f8c06f49d3a5810, role_id=b984563875e9456592cc79cc4869741d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:38.199351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b3e72-332f-4367-8b29-b5331fe7408e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:38.200289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b3e72-332f-4367-8b29-b5331fe7408e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:38.200544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b3e72-332f-4367-8b29-b5331fe7408e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:38.200813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b3e72-332f-4367-8b29-b5331fe7408e admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/2904526cac37478bb9fd712ac29f86f8/roles/b984563875e9456592cc79cc4869741d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:38.206428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6018e-3cc7-4f5c-bc61-4f1705ff0e53 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:38.233223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b3e72-332f-4367-8b29-b5331fe7408e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=2904526cac37478bb9fd712ac29f86f8, role_id=b984563875e9456592cc79cc4869741d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:38.240199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 274/547] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:38 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/6d09511f0bb7411f9f8c06f49d3a5810/roles/b984563875e9456592cc79cc4869741d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:38.245973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b3e72-332f-4367-8b29-b5331fe7408e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:38.276289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 274/548] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:38 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/2904526cac37478bb9fd712ac29f86f8/roles/b984563875e9456592cc79cc4869741d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:04:39.971530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e948d24-07f9-4bdd-b5da-989ede5f205e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:39.972270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e948d24-07f9-4bdd-b5da-989ede5f205e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:39.972634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e948d24-07f9-4bdd-b5da-989ede5f205e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:39.976587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 275/549] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:39 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:39.987051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4597b3-33fe-4bc6-80d6-624441ff7327 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:39.987780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4597b3-33fe-4bc6-80d6-624441ff7327 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:39.987780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4597b3-33fe-4bc6-80d6-624441ff7327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.022119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6e4597b3-33fe-4bc6-80d6-624441ff7327 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:40.023373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6e4597b3-33fe-4bc6-80d6-624441ff7327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:40.137152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 275/550] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:40.190526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e948d24-07f9-4bdd-b5da-989ede5f205e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.220009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e948d24-07f9-4bdd-b5da-989ede5f205e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.232353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.234219 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.234219 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.234830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.250408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:40.262057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:40.263369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 276/551] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:40.274706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4597b3-33fe-4bc6-80d6-624441ff7327 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.301963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4597b3-33fe-4bc6-80d6-624441ff7327 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.315869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.316565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.316845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.317122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.317948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:40.318253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.319923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.340537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 276/552] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:40.350755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.361383 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9575db-ddc5-4660-bfaf-a68850354d4d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.379330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a03033-820c-4899-9a5b-5c0c2f17d261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.380156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03033-820c-4899-9a5b-5c0c2f17d261 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.380440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03033-820c-4899-9a5b-5c0c2f17d261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.380719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a03033-820c-4899-9a5b-5c0c2f17d261 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.399063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a03033-820c-4899-9a5b-5c0c2f17d261 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.400890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a03033-820c-4899-9a5b-5c0c2f17d261 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.424005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-07a03033-820c-4899-9a5b-5c0c2f17d261 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:40.427714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 277/553] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:40.438254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.459934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abcb5a-e88a-41fc-b80b-85a45d27010f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.475587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.476289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.476627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.476878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.477619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:40.477932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.479667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.503819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5ecb-13e7-4638-b5b2-c2caf7cf9478 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.504218 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5ecb-13e7-4638-b5b2-c2caf7cf9478 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.504435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e5ecb-13e7-4638-b5b2-c2caf7cf9478 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.506281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 278/554] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:40.506999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 277/555] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:40.516156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486e79-9af0-4275-b37a-97113751b212 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.516517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486e79-9af0-4275-b37a-97113751b212 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.516723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0486e79-9af0-4275-b37a-97113751b212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.517182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.534930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b57f34-dc48-40a1-bddf-3a5f1945ae2a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.550922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f0486e79-9af0-4275-b37a-97113751b212 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:40.553836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f0486e79-9af0-4275-b37a-97113751b212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:40.556688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.558168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.558737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.559291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.589974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 279/556] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:40.590327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.594804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.627170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:04:40.629586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 278/557] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/users/nova => generated 82 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:40.639239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0486e79-9af0-4275-b37a-97113751b212 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.648274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.666915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0486e79-9af0-4275-b37a-97113751b212 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.674123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e77883-9524-4c58-bb2a-0d6ade7e0f58 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.683860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.686072 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.686912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.687790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.689224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:40.689921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.693711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.694260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.694947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.695220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.695490 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.712499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:40.727989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:40.730410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 279/558] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/roles/service => generated 85 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:40.732917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 280/559] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:40.742550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.744024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.754897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb300c-e3c8-4382-b8f1-fe1871b09b45 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.763198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.766448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f30118-6595-48bb-9498-b63ce6e112e2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.767358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.768095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.768788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.770129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:40.771027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.774171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.775499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.776227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.778012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.778241 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.795048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 280/560] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:40.797450 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.799346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.801958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.817037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114f963-bfbf-414a-8af3-1b3bace8cb47 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.823047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 281/561] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:40.839743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.840177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.840430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.840430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.840430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.860680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ad54bf-23bf-4f11-bcc5-26804de61d81 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.871092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.880129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.881567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.883189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:40.883956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:40.885498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:40.927770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:40.931159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:40.934602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:40.938541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 281/562] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 137 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:40.946933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:40.982902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:40.990124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ecdb-a176-458f-a7ea-c4f95e080207 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:40.992284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 282/563] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:40.997992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:40.999574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.000289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.001007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.002675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.003421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.006737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.012508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.040373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1d022-fb25-43d6-bf1e-d6c396a9aff3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.052273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 282/564] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.056557 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.058039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.058583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.059282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.060035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.061937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.062751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.066068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.080336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da0439-0cef-45c4-928d-942497bb938e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.088413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 283/565] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.099769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.101960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.103324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.103867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.104406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.123641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.128061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b304-b1c4-4c64-8218-2be0fad837d6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.128469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.145054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.147467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.151449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.152216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.177468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.182571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.191818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 16 03:04:41.199659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 283/566] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/users/glance => generated 84 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:41.209603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.221709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:41.223372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 284/567] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:41.230757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf33ece-1fc5-4672-8993-aa974dec4ec4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.233684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.243102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.244093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.244519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.244935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.246156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.246614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.248731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.261984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad3b9-adc6-4663-9c34-51f6ab930e8b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.276326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.277262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.277711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.278155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.279130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.279591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.282170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.289073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 284/568] 10.222.0.31 () {56 vars in 1158 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.300495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.315752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dab42-0f96-4f05-84d4-911e103f7bd4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.316252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 285/569] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.326112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.327215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.327800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.328221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.330948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.345606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe88ac-ec6e-457e-adde-a02f89c3038f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.351552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.354255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.362074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.363095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.363525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.363939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.365011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=cf258dbbf82147618bc5310aebd91a65) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.365536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.367668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.378493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 285/570] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:41.381557 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 286/571] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/role_assignments?user.id=cf258dbbf82147618bc5310aebd91a65&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.389404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.399427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c70d8-42ed-4607-94dc-5ab42817d185 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.410173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.411632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.412089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.412518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.430199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.432472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.461522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:41.466633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 286/572] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:41.470774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.491327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f374f-bc43-4a0f-8f55-5bdeef44fe3e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.503156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c759042-799c-496a-b4b3-a689d6befaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.504238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c759042-799c-496a-b4b3-a689d6befaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.504759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c759042-799c-496a-b4b3-a689d6befaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.505256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c759042-799c-496a-b4b3-a689d6befaa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.506285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c759042-799c-496a-b4b3-a689d6befaa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.506827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c759042-799c-496a-b4b3-a689d6befaa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.508771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c759042-799c-496a-b4b3-a689d6befaa2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.536460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 287/573] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.543003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.556238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87292d29-52ed-487c-916f-6b78ad4c3226 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.556871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87292d29-52ed-487c-916f-6b78ad4c3226 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.557371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87292d29-52ed-487c-916f-6b78ad4c3226 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.559758 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 288/574] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:41 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:41.565857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c91b-24c4-4005-91b6-6e478c54cf66 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.567223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05121-d45f-4199-80cc-1be856c4dbee None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.567752 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05121-d45f-4199-80cc-1be856c4dbee None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.568261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05121-d45f-4199-80cc-1be856c4dbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.581935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.583141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.583541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.583941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.612877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-deb05121-d45f-4199-80cc-1be856c4dbee None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:41.615195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-deb05121-d45f-4199-80cc-1be856c4dbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:41.618430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.622346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.629925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 289/575] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:41.631426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e0a1-c885-4223-8d52-efaa9e197774 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.631708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e0a1-c885-4223-8d52-efaa9e197774 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.632031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4e0a1-c885-4223-8d52-efaa9e197774 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.634145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 290/576] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:41.640750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de667-022c-45db-9980-e09c9e0b65fb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.641080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de667-022c-45db-9980-e09c9e0b65fb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.641363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79de667-022c-45db-9980-e09c9e0b65fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.648434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:41.651150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 287/577] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:41.659305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.661901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d79de667-022c-45db-9980-e09c9e0b65fb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:41.663208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d79de667-022c-45db-9980-e09c9e0b65fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:41.672523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 291/578] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:41.692215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5898c1-0e83-499b-892a-6e4a45ca1e8c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.698367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de667-022c-45db-9980-e09c9e0b65fb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.704512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.705609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.706043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.706455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.708346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.708803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.708975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79de667-022c-45db-9980-e09c9e0b65fb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.712287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.714377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.715323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.715604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.715869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.730659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:41.733796 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 288/579] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.735164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.738040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:41.739826 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 292/580] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:41.740689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.751948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c7efb-af80-4d21-a949-b7234126aca1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.758520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.759555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.759851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.760193 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.763165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d7201-c472-44ff-a2b6-e17ee2b70ac9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.772102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.774412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.774412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.774412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.774412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=c3fd595065064131926ed83613a82ffc) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.774942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.776331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:41.776613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.784534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 293/581] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/role_assignments?user.id=c3fd595065064131926ed83613a82ffc&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.785529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.789742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:41.793177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 289/582] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:41.797144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76fd1e-32a4-406b-9160-66e7eb49ec11 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.802238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.802937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.803224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.803490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.804532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.804706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.806288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.810198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.826273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 294/583] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:41.827591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.840247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38fc35-3124-4a5c-9c59-921c4454b3e1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.842225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147583b-70e8-4e75-a516-5882c029f173 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.864106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.864584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.864584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.864584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.865875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.866596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.866904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.868652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.869017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.870522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.872040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.880906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 290/584] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:41.888041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.896163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.900677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.900991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8717527-2983-422c-b29f-cf6e6a736838 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.906567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.907553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.907940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.908276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.923050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.923879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.943437 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:41.950927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:41.950927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 291/585] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:41.952648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 295/586] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:41.956831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.963585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:41.976228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee9677-9734-485b-8f5f-79c1f8638194 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.980371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f136a2e-3705-46ae-a153-4bc89318b09d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:41.981872 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.982809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.983254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.984122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.984790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:41.985202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:41.987359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:41.992783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bc294-6310-4a62-827e-710c3bd5ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:41.994966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bc294-6310-4a62-827e-710c3bd5ff49 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:41.995705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bc294-6310-4a62-827e-710c3bd5ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:41.996371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bc294-6310-4a62-827e-710c3bd5ff49 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:41.999171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bc294-6310-4a62-827e-710c3bd5ff49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.000774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bc294-6310-4a62-827e-710c3bd5ff49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.004157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 296/587] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.004883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bc294-6310-4a62-827e-710c3bd5ff49 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.011257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.022886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d44c5c-8e00-4422-9aec-b0a80aff6684 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.030929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e17fbe-cf8a-4d53-a02a-0d5c6b0f4b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.032088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17fbe-cf8a-4d53-a02a-0d5c6b0f4b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.032661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17fbe-cf8a-4d53-a02a-0d5c6b0f4b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.033184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e17fbe-cf8a-4d53-a02a-0d5c6b0f4b11 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.038736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 292/588] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:42.041474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a98c2-f41a-4a48-b46c-d6cf8baf211c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.046183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a98c2-f41a-4a48-b46c-d6cf8baf211c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.046848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a98c2-f41a-4a48-b46c-d6cf8baf211c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.049458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 293/589] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:42 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:42.051073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17fbe-cf8a-4d53-a02a-0d5c6b0f4b11 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.053764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a98c2-f41a-4a48-b46c-d6cf8baf211c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.055989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e17fbe-cf8a-4d53-a02a-0d5c6b0f4b11 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.074825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-03e17fbe-cf8a-4d53-a02a-0d5c6b0f4b11 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 03:04:42.076232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a98c2-f41a-4a48-b46c-d6cf8baf211c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.077254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 297/590] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.082233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.083206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.083592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.083978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.084609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6d88d-985d-4122-876c-576d2caabcc2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.085401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6d88d-985d-4122-876c-576d2caabcc2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.086057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6d88d-985d-4122-876c-576d2caabcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.093844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.096047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.118864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 03:04:42.119976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b1d6d88d-985d-4122-876c-576d2caabcc2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:42.121355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 294/591] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/users/cinder => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.122352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b1d6d88d-985d-4122-876c-576d2caabcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:42.122857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.137389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 298/592] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:42.138483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6d88d-985d-4122-876c-576d2caabcc2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.140443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3b64c-d1ac-4e7c-8707-c751520431fe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.145703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.146435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.146765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.147045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.147978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.148324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.150401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.166963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6d88d-985d-4122-876c-576d2caabcc2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.172843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.173577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.173860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.174132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.175008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.175315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.177201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.194041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 295/593] 10.222.0.31 () {56 vars in 1156 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.196277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.207427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 299/594] 10.222.0.31 () {56 vars in 1158 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.209166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.219843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeba47-2797-4bc4-9065-a8e8718441d2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.223880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb132a-22b1-4003-a0b2-f38e064dd426 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.228974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.229235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.230634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.230876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.231093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.231468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.231685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.231923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.246541 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.248998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.263114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:42.275100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:42.275670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:42.277017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 300/595] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.278107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 296/596] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.278267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.286564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.300205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3564303b-3611-446b-8ee9-e650e70c39e7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.300731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf1b9-39d3-4ff3-b62f-301d61f48363 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.306944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.307599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.307884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.308199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.309769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.311155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.311695 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.312111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.313051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.313527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.315339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.317876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.319774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.325706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 297/597] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.326874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.336066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 301/598] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:42.336958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.338298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d79092-0436-4f91-950c-2e17e0110917 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.343782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.344750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.345177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.345696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.346590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.347453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.349383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.352633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f110e8-2ba4-4fd8-af9c-5bcf7de2e1d1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.357281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.358851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.358851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.358851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.370015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 298/599] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.370333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.371520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.372109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.383725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be1379-b34a-48d2-8ca5-f14981cee8ca admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.388915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.390309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.390948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.391416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.391822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:42.393090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 302/600] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.398106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.406542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.409663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac4b75e-580c-4fc9-a612-8b0b35ee4468 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.411457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.415149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.415969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.416303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.416579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.425092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.427168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.433268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:42.435113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 299/601] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.436092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.446980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:42.447731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb391-e041-45ff-a885-10a3261d2f68 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.453459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 303/602] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.453459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.459177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.460088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.460509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.460987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.461600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb96d1-35ef-4754-ad71-6a39153b13bc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.462097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.462542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.464665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.466667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.467287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.467691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.468027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.468932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.469133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.471023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.480256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 300/603] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.481392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.490369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 304/604] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.491287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.493312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9405c-4def-4f75-8abc-30e5feeec355 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.506004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.507032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99d01a9-a9ff-4270-8154-ac44a66c4405 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.508022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.509125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.510039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.511970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.512304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.512701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.513259 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.513634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.513979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.515860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.523473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.529477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.538584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 301/605] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.539838 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.553006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719fe8b-6c27-4b38-8020-664b64a2b80b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.558739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.559830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.560300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.560750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.563692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 16 03:04:42.565805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 305/606] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/users/neutron => generated 85 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.569618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.574847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.577545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.587709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf96cf-3429-4e80-a3f3-222010f9fe44 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.594169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:42.596099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 302/607] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.601472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.601472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.601472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.601472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/b580550112ae4c51a3bffea61ede5bb2/roles/b984563875e9456592cc79cc4869741d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.602923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.615201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feff67a-2d87-4ce2-8a53-98a0dba40a9b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.622488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.623552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.624136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.624945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.626522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.627033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.629407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.631894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=b580550112ae4c51a3bffea61ede5bb2, role_id=b984563875e9456592cc79cc4869741d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.636011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.663170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 303/608] 10.222.0.31 () {56 vars in 1160 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.663170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.663447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 306/609] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:42 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/b580550112ae4c51a3bffea61ede5bb2/roles/b984563875e9456592cc79cc4869741d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:42.675822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.682131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5219d89a-8675-49b4-86c4-cb75d6876e1e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.801613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0785355-ac86-4f45-99af-ac2bce8db9f0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.808861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.809667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.810014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.810357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.811941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.812679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.815861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.816694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.817035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.817371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.817939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.835646 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.841339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.845230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 304/610] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.856877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.867090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 307/611] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:42.871409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdd9f1-30ee-42ee-8938-97a59ed4c443 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.873995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.885279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.886010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.886290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.886566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.887572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=2904526cac37478bb9fd712ac29f86f8) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.887945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.890058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.894719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79c3c10-bd86-48d7-84fd-c67d817f8ad5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.903833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.905598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 305/612] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/role_assignments?user.id=2904526cac37478bb9fd712ac29f86f8&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:42.905913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.906067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.906258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.921252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.923902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:42.945717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:42.947399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 308/613] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:42.955374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:42.970706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9807c4-35b5-4b3a-b6ae-bc16b6ad64dd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:42.977875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:42.978606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:42.978935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:42.979221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:42.980082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:42.980403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:42.982213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:43.003007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 306/614] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:43.010476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:43.031224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558cce6-53da-4fd9-8f90-ef1d56284348 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:43.040581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:43.042701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:43.043529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:43.044385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:43.060135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:43.064857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:43.095858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:43.105736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 309/615] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:43.114779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:43.138062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6cc8c0-bdfe-4c18-b00e-bd2e14ffa101 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:43.148936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062da89e-0e02-49b2-9219-b3577416dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:43.150127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da89e-0e02-49b2-9219-b3577416dc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:43.150625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da89e-0e02-49b2-9219-b3577416dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:43.151262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062da89e-0e02-49b2-9219-b3577416dc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:43.152324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062da89e-0e02-49b2-9219-b3577416dc7f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:43.152894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062da89e-0e02-49b2-9219-b3577416dc7f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:43.155785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062da89e-0e02-49b2-9219-b3577416dc7f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:43.178587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 307/616] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:43.185323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:43.197763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e247fcd-5ef9-4520-9650-bc78b34d40b8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:43.203438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3caafa-846a-4171-aed5-6d87ae2f4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:43.204420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3caafa-846a-4171-aed5-6d87ae2f4e4c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:43.204929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3caafa-846a-4171-aed5-6d87ae2f4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:43.205459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3caafa-846a-4171-aed5-6d87ae2f4e4c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:43.206573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3caafa-846a-4171-aed5-6d87ae2f4e4c admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=6d09511f0bb7411f9f8c06f49d3a5810) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:43.207135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3caafa-846a-4171-aed5-6d87ae2f4e4c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:43.209358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3caafa-846a-4171-aed5-6d87ae2f4e4c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:43.221612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 310/617] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:43 2021] GET /identity/v3/role_assignments?user.id=6d09511f0bb7411f9f8c06f49d3a5810&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:44.859264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c6ef-d3c3-496f-87a8-bda5bc6d0e19 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:44.860240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c6ef-d3c3-496f-87a8-bda5bc6d0e19 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:44.860716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c6ef-d3c3-496f-87a8-bda5bc6d0e19 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:44.863190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 308/618] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:44 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:44.869173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcdd85-ce85-4caa-8929-fef76a1fc500 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:44.870133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcdd85-ce85-4caa-8929-fef76a1fc500 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:44.870599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcdd85-ce85-4caa-8929-fef76a1fc500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:44.894480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-dcfcdd85-ce85-4caa-8929-fef76a1fc500 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:44.896054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-dcfcdd85-ce85-4caa-8929-fef76a1fc500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:44.909061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 311/619] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:44.959658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38c6ef-d3c3-496f-87a8-bda5bc6d0e19 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:44.978461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38c6ef-d3c3-496f-87a8-bda5bc6d0e19 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:44.983336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:44.984709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:44.985233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:44.985727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:44.997196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:45.005024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:45.006988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 309/620] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:45.013205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcdd85-ce85-4caa-8929-fef76a1fc500 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.023393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcdd85-ce85-4caa-8929-fef76a1fc500 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.032881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.033978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.034457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.034949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.036300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:45.036804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.038659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.049094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 312/621] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:45.054989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.071751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c960218-df55-4c8a-bb0b-cfff255bb3a1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.077701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.078965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.079478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.079948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.097833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.105467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.133230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:45.138733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 310/622] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:45.151974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.171491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c9ad3-ee79-4384-9975-3ff20e3a4a2d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.183336 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b084172-2c38-4342-ba0d-26980fc7cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.184421 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b084172-2c38-4342-ba0d-26980fc7cf6e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.184928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b084172-2c38-4342-ba0d-26980fc7cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.185407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b084172-2c38-4342-ba0d-26980fc7cf6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.186956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b084172-2c38-4342-ba0d-26980fc7cf6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:45.187517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b084172-2c38-4342-ba0d-26980fc7cf6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.193862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b084172-2c38-4342-ba0d-26980fc7cf6e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.219300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 313/623] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:45.226139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.245459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5dd96-ce9d-4c46-b46f-93a1e59445bf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.251865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65497cd-2d04-4940-b0a7-382ebe75c3ed None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.252157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65497cd-2d04-4940-b0a7-382ebe75c3ed None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.252435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65497cd-2d04-4940-b0a7-382ebe75c3ed None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.254324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.255936 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 314/624] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:45.256995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.257538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.258064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.262787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380a79-9a1e-4cec-a873-be52d2560d98 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.262922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380a79-9a1e-4cec-a873-be52d2560d98 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.263319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a380a79-9a1e-4cec-a873-be52d2560d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.275985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.279103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.305467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9a380a79-9a1e-4cec-a873-be52d2560d98 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:45.305467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9a380a79-9a1e-4cec-a873-be52d2560d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:45.310243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:04:45.312282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 311/625] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:45.319476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.325543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 315/626] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:45.343591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b95b2-7478-496a-9492-746283349df5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.348343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.349076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.349361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.349702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.350627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:45.350937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.352931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.389698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a380a79-9a1e-4cec-a873-be52d2560d98 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.393686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 312/627] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:45.403569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.403753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a380a79-9a1e-4cec-a873-be52d2560d98 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.414763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.415622 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fa9bfc-a60b-43cc-9259-93e78dc4af65 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.418746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.419227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.419680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.437457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.437457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.437457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.437457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.461467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.461467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.473460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.477451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.484651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 313/628] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:04:45.493466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.509458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e8f82-69e1-4af8-bb8c-e081c1cf3237 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.525456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.525456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.525456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.525456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.553465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.557452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:45.561476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.566691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 316/629] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:45.577478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.609550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:45.629465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 314/630] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 133 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:45.629465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.629850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b5480-d9bb-43da-834e-4bc86d8e473a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.652941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21b6d4-d9d7-4c0e-9d95-210e5931e4d5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.658361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.659468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.659933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.661471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.662766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:45.663494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.668160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.676241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.677327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.677843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.678312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.679809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:45.680167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.683153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.724070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 317/631] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:45.731993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.734445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 315/632] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:45.738739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.769467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ca8f-907a-44b7-9cb5-7ca75d7f132c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.778283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb216ee5-7ee5-4378-ba04-34f6e47a5c13 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.789363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.790083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.790361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.790633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.791365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.797474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.799060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.800706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.801605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.802451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.857192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.864673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:45.880553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 318/633] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:04:45 2021] POST /identity/v3/users => generated 254 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:04:45.897643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:45.899913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 316/634] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:45.910672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:45.938352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6758793-dbf8-4577-ba40-2426ca42c5bb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:45.958661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a4f0f-b2fa-42bc-aac7-376e53ab90e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:45.959606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a4f0f-b2fa-42bc-aac7-376e53ab90e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:45.959886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a4f0f-b2fa-42bc-aac7-376e53ab90e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:45.960158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a4f0f-b2fa-42bc-aac7-376e53ab90e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:45.961019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a4f0f-b2fa-42bc-aac7-376e53ab90e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:45.961327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a4f0f-b2fa-42bc-aac7-376e53ab90e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:45.967956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a4f0f-b2fa-42bc-aac7-376e53ab90e3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.000747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 319/635] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:46.011532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.026739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fbb5e-54a3-4fe1-a7c0-44b87a0bdaaf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.037999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c518127-9c45-4dfe-aa1d-9f71a83d23c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.039102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c518127-9c45-4dfe-aa1d-9f71a83d23c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.039590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c518127-9c45-4dfe-aa1d-9f71a83d23c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.040065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c518127-9c45-4dfe-aa1d-9f71a83d23c4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.041190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c518127-9c45-4dfe-aa1d-9f71a83d23c4 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=cf258dbbf82147618bc5310aebd91a65) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:46.041833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c518127-9c45-4dfe-aa1d-9f71a83d23c4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.043997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c518127-9c45-4dfe-aa1d-9f71a83d23c4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.052072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 317/636] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/role_assignments?user.id=cf258dbbf82147618bc5310aebd91a65&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:46.339276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2939fa-2a4c-4f43-8bc7-f3dd8075d402 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.339775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2939fa-2a4c-4f43-8bc7-f3dd8075d402 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.340275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2939fa-2a4c-4f43-8bc7-f3dd8075d402 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.344691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 320/637] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:46.351901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688132-640d-4335-b9bc-e5bada0455d3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.352361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688132-640d-4335-b9bc-e5bada0455d3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.352812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9688132-640d-4335-b9bc-e5bada0455d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.392961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f9688132-640d-4335-b9bc-e5bada0455d3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:46.394992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f9688132-640d-4335-b9bc-e5bada0455d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:46.412819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 318/638] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:46.449610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2939fa-2a4c-4f43-8bc7-f3dd8075d402 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.475941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2939fa-2a4c-4f43-8bc7-f3dd8075d402 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.485341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a3724-31fd-4ef0-88a5-d27c7128c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.486786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3724-31fd-4ef0-88a5-d27c7128c3af admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.487279 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3724-31fd-4ef0-88a5-d27c7128c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.487763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3724-31fd-4ef0-88a5-d27c7128c3af admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.515153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a3724-31fd-4ef0-88a5-d27c7128c3af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:46.529016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-005a3724-31fd-4ef0-88a5-d27c7128c3af admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:46.539789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 321/639] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:46.550768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9688132-640d-4335-b9bc-e5bada0455d3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.560808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7fb56-7e77-49fb-9ac8-ea4b429a9fa4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.561390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7fb56-7e77-49fb-9ac8-ea4b429a9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.561921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab7fb56-7e77-49fb-9ac8-ea4b429a9fa4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.565360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 322/640] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:46.573911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7bcd-55aa-4aed-8274-09e2c97bd2b5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.574407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7bcd-55aa-4aed-8274-09e2c97bd2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.574897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7bcd-55aa-4aed-8274-09e2c97bd2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.575881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9688132-640d-4335-b9bc-e5bada0455d3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.588472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.589723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.590147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.590637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.592086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:46.592673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.596376 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.619948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 319/641] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:46.628022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.634533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8fcd7bcd-55aa-4aed-8274-09e2c97bd2b5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:46.641961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8fcd7bcd-55aa-4aed-8274-09e2c97bd2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:46.666067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb5df8-74a1-4625-abb2-0ca8ae1eadcc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.669976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 323/642] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:46.686720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.688168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.688723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.689218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.696242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7bcd-55aa-4aed-8274-09e2c97bd2b5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.727460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.729527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7bcd-55aa-4aed-8274-09e2c97bd2b5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.732498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.744726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.747921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.750408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.750933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.753695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.757356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:46.757356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:46.757356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:46.759128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.806373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:46.808874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 320/643] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:46.812294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 16 03:04:46.814836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 324/644] 10.222.0.31 () {56 vars in 1150 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:46.821824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.822090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.842230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e747b5d-5835-4b55-8e7a-6edc466d6e77 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.850514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52c18-2b0e-4757-9aad-808135c28ab6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.857881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.858330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.859173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.859415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.859624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.859860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.860068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.860362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.861308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:46.861591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:46.861838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.862129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.863815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:46.863815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:46.863815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:46.864574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.873714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.882493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 321/645] 10.222.0.31 () {56 vars in 1145 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:46.890020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.891462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 325/646] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:46.898197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:46.921510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a175f-031e-4c7a-ba0d-45e9dcfb42c0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.921776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ef25e-f1b3-4624-b212-5dbf7fa9883c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:46.927201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.928329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.928818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.929304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.930668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:46.931209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.934242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:46.939724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:46.940765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:46.941278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:46.941738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:46.945617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 322/647] 10.222.0.31 () {56 vars in 1145 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:46.971594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:46.973934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.010139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 03:04:47.012350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 326/648] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:46 2021] GET /identity/v3/users/swift => generated 83 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:47.019150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.035546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b22ff7-4e85-406e-8438-260aa2ede9ed admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.051454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.052579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.053123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.053618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.054681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:47.055186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.057943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.087103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 323/649] 10.222.0.31 () {56 vars in 1156 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:47.093923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.121342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee231f-ba25-4cd2-aa35-75a74e88b927 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.136859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.137961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.138432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.138861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.159067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.162520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.183788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 327/650] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:47.190438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.207965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714a29f-ede4-4fdc-ae7b-ea70481bb8e0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.219658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.220869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.221399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.221906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.237454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.245470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.269352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:47.271413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 324/651] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:47.278116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.301360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827b5c-59e4-49e4-ae00-d9fa9d0b7841 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.311448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.312559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.313045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.313550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.314891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:47.315423 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.318000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.335727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 328/652] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:47.342435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.356308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff84f3-1798-455e-a678-a3047eebc84d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.366296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.367463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.367959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.368429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.391949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.395759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.424470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:47.435091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 325/653] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:47.441498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.464220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d6690-9d75-481f-b46f-e9185baec5d1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.477669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fca6d5-f5ed-4dc4-b60d-d88c51b6de74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.478359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca6d5-f5ed-4dc4-b60d-d88c51b6de74 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.478636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca6d5-f5ed-4dc4-b60d-d88c51b6de74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.478906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca6d5-f5ed-4dc4-b60d-d88c51b6de74 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.479734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fca6d5-f5ed-4dc4-b60d-d88c51b6de74 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:47.480040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fca6d5-f5ed-4dc4-b60d-d88c51b6de74 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.481964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fca6d5-f5ed-4dc4-b60d-d88c51b6de74 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.496908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 329/654] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:47.504462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.530385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f8d30-eb62-4cde-a8d9-3f24a553c4c0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.544192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4ec77-2e6c-4c96-86e7-6d555f0d97f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.545419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4ec77-2e6c-4c96-86e7-6d555f0d97f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.546740 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4ec77-2e6c-4c96-86e7-6d555f0d97f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.547226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4ec77-2e6c-4c96-86e7-6d555f0d97f4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.548973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4ec77-2e6c-4c96-86e7-6d555f0d97f4 admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=b580550112ae4c51a3bffea61ede5bb2) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:47.549626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4ec77-2e6c-4c96-86e7-6d555f0d97f4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.553391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4ec77-2e6c-4c96-86e7-6d555f0d97f4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.571324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 326/655] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/role_assignments?user.id=b580550112ae4c51a3bffea61ede5bb2&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 608 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:47.692994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ebf47-72b9-4109-884f-f28d564ed6b9 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.693221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ebf47-72b9-4109-884f-f28d564ed6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.693615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ebf47-72b9-4109-884f-f28d564ed6b9 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.695978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 330/656] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:47.706545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7501c7-de43-41dc-88a3-7f0b0d863ee4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.706976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7501c7-de43-41dc-88a3-7f0b0d863ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.707396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7501c7-de43-41dc-88a3-7f0b0d863ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.743876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1c7501c7-de43-41dc-88a3-7f0b0d863ee4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:47.745950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1c7501c7-de43-41dc-88a3-7f0b0d863ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:47.762901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 327/657] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:47.835432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ebf47-72b9-4109-884f-f28d564ed6b9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.852801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ebf47-72b9-4109-884f-f28d564ed6b9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.859945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.860785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.861065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.861331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.862077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.863754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.882480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 16 03:04:47.883823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 331/658] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/services/network => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:47.895052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7501c7-de43-41dc-88a3-7f0b0d863ee4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.916134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7501c7-de43-41dc-88a3-7f0b0d863ee4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.926047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ed0e-a318-4f94-ba9d-386ea55cacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.927194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ed0e-a318-4f94-ba9d-386ea55cacab admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.927646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ed0e-a318-4f94-ba9d-386ea55cacab admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.928063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ed0e-a318-4f94-ba9d-386ea55cacab admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.929359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ed0e-a318-4f94-ba9d-386ea55cacab admin admin] RBAC: Adding query filter params (name=network) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:47.929863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ed0e-a318-4f94-ba9d-386ea55cacab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.932656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ed0e-a318-4f94-ba9d-386ea55cacab admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:47.949252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 328/659] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/services?name=network => generated 124 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:47.959514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:47.976195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26053c9-4341-4a33-8836-a1f1373248c2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:47.985734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:47.986429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:47.986704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:47.986972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:47.987712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:47.988013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:47.989057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:47.989057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:47.989057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:47.989985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0daf48-fdcc-4bdf-9c4f-1d537dbdc0c8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:48.003530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 332/660] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:04:47 2021] GET /identity/v3/services?type=network => generated 124 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:49.159888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51baa-93a0-47d1-b99e-d18ca3103e87 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.160577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51baa-93a0-47d1-b99e-d18ca3103e87 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.161115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd51baa-93a0-47d1-b99e-d18ca3103e87 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.164947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 329/661] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:49.174640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a748a76-7fe1-4a13-a109-bccd3c9557af None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.175284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a748a76-7fe1-4a13-a109-bccd3c9557af None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.175284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a748a76-7fe1-4a13-a109-bccd3c9557af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.202739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0a748a76-7fe1-4a13-a109-bccd3c9557af None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:49.203973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0a748a76-7fe1-4a13-a109-bccd3c9557af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:49.212371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 333/662] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:49.254041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51baa-93a0-47d1-b99e-d18ca3103e87 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.286957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd51baa-93a0-47d1-b99e-d18ca3103e87 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.294353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0bfe21-f473-4dfd-9717-fd06d6315bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.295749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfe21-f473-4dfd-9717-fd06d6315bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.296219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfe21-f473-4dfd-9717-fd06d6315bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.296705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0bfe21-f473-4dfd-9717-fd06d6315bd9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.326984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0bfe21-f473-4dfd-9717-fd06d6315bd9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:49.340514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ed0bfe21-f473-4dfd-9717-fd06d6315bd9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:49.347290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 330/663] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:49.356946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a748a76-7fe1-4a13-a109-bccd3c9557af None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.370989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a748a76-7fe1-4a13-a109-bccd3c9557af None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.382837 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.383536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.383866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.384169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.384949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:49.385253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.386927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f9fb-4361-4fe5-84a9-7a50e826e8f8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.387165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.387364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f9fb-4361-4fe5-84a9-7a50e826e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.387825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5f9fb-4361-4fe5-84a9-7a50e826e8f8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.391910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 331/664] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:49 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:49.403374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c97ef-1bc0-415c-8638-af195d24c35f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.403801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c97ef-1bc0-415c-8638-af195d24c35f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.404213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c97ef-1bc0-415c-8638-af195d24c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.409640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 334/665] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:49.420436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.431711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-133c97ef-1bc0-415c-8638-af195d24c35f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:49.433201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-133c97ef-1bc0-415c-8638-af195d24c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:49.443412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c95662-9496-4d15-88a4-f75bd8eb1cb5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.449249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 332/666] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 16 03:04:49.459641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.460462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.460739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.461006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.473339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.475256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.490938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c97ef-1bc0-415c-8638-af195d24c35f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.504509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:49.513296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c97ef-1bc0-415c-8638-af195d24c35f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.514474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 335/667] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:49.517450 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.533628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.534995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.535476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.536302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.545829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6a04b-1d8e-4342-8cb8-30369de832fe admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.567411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.568510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.569001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.569469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.570816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:49.571357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.574376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.578704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:49.603554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:49.603554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 333/668] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:49.619922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 336/669] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:49.624524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.630764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.656338 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40126a-ac3c-439c-b14f-da7c15809a45 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.661416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2c9b6-72ba-4db3-b7c4-0b3ea32692bd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.674690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.675879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.676332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.676765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.678689 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.679832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.680301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.680788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.682291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:49.682848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.686112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.710001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.714154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.721220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 334/670] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:49.743448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.772043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec36ff3-004e-41e5-a34d-38ba08a4def0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.777073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:04:49.779356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 337/671] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:49.786955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.788332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.788818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.789334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.791280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.822120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46191f6-0827-4647-9622-39290c8ce019 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.827186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.830563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.836175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.837824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.838659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.839361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.841272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:49.842097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.846977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.880777 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:49.882952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 335/672] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:49.892248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.892663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 338/673] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:49.915102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462fa3d-d1f6-4dfd-87f4-89641c82df56 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.921847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:49.928244 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.930745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.931293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.933561 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.934911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:49.936522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:49.942802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:49.962084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac995d-de21-4d8c-a1a6-37d33444d9a9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:49.982679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:49.984550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:49.985979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:49.986281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:49.989123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 336/674] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:49.999289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.013310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.015845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.019198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3267a-5ea9-4198-b3a4-8a7c6d9aed4d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.038392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.039723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.040209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.040691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.071485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.075341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.080712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:50.082846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 339/675] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:50.096200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.118571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6869f-a01b-4050-9ac4-2c59695640dc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.119991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 03:04:50.122615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 337/676] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:04:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:50.130074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.134765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.135447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.135723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.135995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.136749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:50.137047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.138685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.149752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b7c0fe-1cb8-40ea-8650-1a426b8e54ce admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.151260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 340/677] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:50.157949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.158736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.160004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.161325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.161325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.162970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:50.163787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.167586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.172023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043411be-fbb7-49da-bc60-cba4c6726f26 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.194297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.195408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.195408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.195862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.203500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.205467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 338/678] 10.222.0.31 () {56 vars in 1170 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:50.208860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.212491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.242959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca0b6-eea6-4b01-966b-7928145a93ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.256752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.259013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.260923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.261986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.279292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:50.280638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 341/679] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:50.287101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.287828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.293512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.308122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 339/680] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:04:50.315505 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.316081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce66596-b73e-4dda-849c-1cd3bc11b0c4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.329634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.333131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.333950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.334951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.338182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:50.339883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.346900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.348760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b7bfb-5e21-423e-aebc-967725a7d822 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.367033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.368991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.372822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.373899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.396957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 342/681] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:50.402978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.404850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.405369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.437454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0dfd-e92f-44c2-a063-5dbd97397c0d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.459768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.461902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.462665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.463424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/cf258dbbf82147618bc5310aebd91a65/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.467429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=cf258dbbf82147618bc5310aebd91a65, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.470793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:50.476543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.479199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 340/682] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:50.487037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.504315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b8b1-db9f-4fbd-b38a-728195f67d07 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.519074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 343/683] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:50 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/cf258dbbf82147618bc5310aebd91a65/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:50.519558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.525647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.525647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.525647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.525647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:50.525647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.525647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.551915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 341/684] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:50.559126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.699133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad323c0-914f-45f2-899b-f227331c78a6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.708033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.710094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.710876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.711644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.726267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.730856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.758801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:50.762040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 344/685] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:50.769373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.789998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500aec85-f5af-47ef-a720-d6e7fae4c56a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.805087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f5e2a-7fa3-45f2-a286-f96db9c959e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.806628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5e2a-7fa3-45f2-a286-f96db9c959e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.807021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5e2a-7fa3-45f2-a286-f96db9c959e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.807442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5e2a-7fa3-45f2-a286-f96db9c959e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.808755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f5e2a-7fa3-45f2-a286-f96db9c959e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:50.809219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f5e2a-7fa3-45f2-a286-f96db9c959e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.821841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f5e2a-7fa3-45f2-a286-f96db9c959e8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.863371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 342/686] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:50.870648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:50.883989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516dfb9-47c2-4968-9b74-8f23f9c17779 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:50.894605 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc0ffa3-5d27-4dc1-b6c7-de98bec21d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:50.895692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ffa3-5d27-4dc1-b6c7-de98bec21d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:50.896192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ffa3-5d27-4dc1-b6c7-de98bec21d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:50.896663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0ffa3-5d27-4dc1-b6c7-de98bec21d94 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:50.897813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ffa3-5d27-4dc1-b6c7-de98bec21d94 admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=ee68d56c327f4e8eb32e019ea2326bfe) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:50.898328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ffa3-5d27-4dc1-b6c7-de98bec21d94 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:50.900406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc0ffa3-5d27-4dc1-b6c7-de98bec21d94 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:50.912694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 345/687] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:50 2021] GET /identity/v3/role_assignments?user.id=ee68d56c327f4e8eb32e019ea2326bfe&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:51.014944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221d3e6-a48d-435e-ae45-ebbb75bb0280 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.015357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221d3e6-a48d-435e-ae45-ebbb75bb0280 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.015682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221d3e6-a48d-435e-ae45-ebbb75bb0280 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.019528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 343/688] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:51 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:51.029042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5d99-6598-4d89-a1ab-8fb0cdc8d85f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.029774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5d99-6598-4d89-a1ab-8fb0cdc8d85f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.030316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b5d99-6598-4d89-a1ab-8fb0cdc8d85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.051258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c83b5d99-6598-4d89-a1ab-8fb0cdc8d85f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:51.052915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c83b5d99-6598-4d89-a1ab-8fb0cdc8d85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:51.064034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 346/689] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 16 03:04:51.100384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221d3e6-a48d-435e-ae45-ebbb75bb0280 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.127098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221d3e6-a48d-435e-ae45-ebbb75bb0280 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.139798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d7c0f-2d22-4f2e-b062-b61dc0803d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.140817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7c0f-2d22-4f2e-b062-b61dc0803d91 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.141232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7c0f-2d22-4f2e-b062-b61dc0803d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.141669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d7c0f-2d22-4f2e-b062-b61dc0803d91 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.142894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d7c0f-2d22-4f2e-b062-b61dc0803d91 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.144590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-420d7c0f-2d22-4f2e-b062-b61dc0803d91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:51.144590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:51.144590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:51.146133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d7c0f-2d22-4f2e-b062-b61dc0803d91 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.193072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 344/690] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:04:51 2021] POST /identity/v3/services => generated 240 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:04:51.490645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a47483-c22c-4062-8bae-b0be8c6cad30 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.491736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a47483-c22c-4062-8bae-b0be8c6cad30 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.492239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a47483-c22c-4062-8bae-b0be8c6cad30 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.494619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 347/691] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:51.501774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0281f-3ccf-4b52-baf0-3bb583676506 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.502425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0281f-3ccf-4b52-baf0-3bb583676506 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.502902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0281f-3ccf-4b52-baf0-3bb583676506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.522218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4ed0281f-3ccf-4b52-baf0-3bb583676506 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:51.524031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4ed0281f-3ccf-4b52-baf0-3bb583676506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:51.543267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 345/692] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:51 2021] POST /identity/v3/auth/tokens => generated 1013 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:51.550163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ee25e-a1d7-46ac-b6e6-c64acf824863 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.550616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ee25e-a1d7-46ac-b6e6-c64acf824863 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.551066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ee25e-a1d7-46ac-b6e6-c64acf824863 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.554457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 348/693] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:51 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:51.565201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9672-cfda-48fb-9368-7e34d7b1904f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.565759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9672-cfda-48fb-9368-7e34d7b1904f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.566213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c9672-cfda-48fb-9368-7e34d7b1904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.571209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ee25e-a1d7-46ac-b6e6-c64acf824863 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.586132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ee25e-a1d7-46ac-b6e6-c64acf824863 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.593122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.594475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.594984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.595089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8e9c9672-cfda-48fb-9368-7e34d7b1904f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:51.595548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.597137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8e9c9672-cfda-48fb-9368-7e34d7b1904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:51.609559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:51.611102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 346/694] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:51 2021] POST /identity/v3/auth/tokens => generated 1013 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:51.617620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:51.619539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 349/695] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:51.626683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9672-cfda-48fb-9368-7e34d7b1904f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.637209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c9672-cfda-48fb-9368-7e34d7b1904f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.642495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.643511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.644080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.644552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.645652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:51.646243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.648130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.656267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.660614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 347/696] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:51.667764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.676296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960460af-070e-4149-aa9f-7414bd15b33c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.679293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed4a16-0e52-4591-a167-8cf32a576121 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.684220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.685040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.685358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.685628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.688621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.690170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.690938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.691697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.694415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.696554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:51.696554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:51.696554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:51.698670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.699122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.700552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.720580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:51.722276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 348/697] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:51.728837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.734371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 350/698] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:04:51 2021] POST /identity/v3/services => generated 251 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:04:51.743635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e45e8-c594-4196-8177-be9eafbd01c0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.759530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.760267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.760550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.760826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.761668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:51.761994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.763696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.778682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 349/699] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:51.785677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.797923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ccec5c-5d60-48af-a512-d97b6cccf9b1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.802681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.803500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.803900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.804080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.813889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.815991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.832348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 03:04:51.834031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 351/700] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:51.841080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.851929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509c95-ad31-4ff9-8448-db55322cf98a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.856961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.857766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.858149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.858484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.859418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:51.859729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.861693 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.884652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 350/701] 10.222.0.31 () {56 vars in 1156 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:51.891757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.903302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14959eb-9b22-48d7-b135-569ca0014e44 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.908785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.909548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.909832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.910104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.921199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.923067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:51.934225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 352/702] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:04:51.941639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:51.952519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecf847-5dca-40a4-9794-aee063e0cef3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:51.957708 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:51.958596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:51.958870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:51.959129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:51.978032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:51.980332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:52.009220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:52.010812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 351/703] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:52.018444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:52.042075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b518e-b630-4fb6-a20b-41003047cdce admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:52.054237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:52.054923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:52.055200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:52.055469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:52.056215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:52.056513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:52.058257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:52.083959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 353/704] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:52.090131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:52.107278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d3a02-29be-44fe-9c88-a98bd25b7fc8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:52.117872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:52.118709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:52.119043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:52.119321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:52.135376 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:52.137496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:52.157549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:52.158834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 352/705] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:52 2021] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:52.166121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:52.183291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e5723-0a25-4887-baa4-5102b60ac93a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:52.193986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094a6c2-72a3-41bb-9b33-cda4bec38303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:52.194673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094a6c2-72a3-41bb-9b33-cda4bec38303 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:52.194949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094a6c2-72a3-41bb-9b33-cda4bec38303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:52.195220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094a6c2-72a3-41bb-9b33-cda4bec38303 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:52.198207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094a6c2-72a3-41bb-9b33-cda4bec38303 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:52.198207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094a6c2-72a3-41bb-9b33-cda4bec38303 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:52.199023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094a6c2-72a3-41bb-9b33-cda4bec38303 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:52.215203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 354/706] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:52.222063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:52.240041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a2d1f-5988-475f-91c4-c4a6b60f8fbf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:52.254443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec4427-b73c-4ea9-95f9-9bc208933cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:52.255138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec4427-b73c-4ea9-95f9-9bc208933cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:52.255415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec4427-b73c-4ea9-95f9-9bc208933cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:52.255674 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec4427-b73c-4ea9-95f9-9bc208933cf5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:52.256540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec4427-b73c-4ea9-95f9-9bc208933cf5 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=b580550112ae4c51a3bffea61ede5bb2) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:52.256994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec4427-b73c-4ea9-95f9-9bc208933cf5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:52.260399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec4427-b73c-4ea9-95f9-9bc208933cf5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:52.267892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 353/707] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:52 2021] GET /identity/v3/role_assignments?user.id=b580550112ae4c51a3bffea61ede5bb2&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:54.094629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcec26-3057-4b5a-9ab1-0e52a7cb1c99 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.095392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcec26-3057-4b5a-9ab1-0e52a7cb1c99 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.095392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dcec26-3057-4b5a-9ab1-0e52a7cb1c99 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.098676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 355/708] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:54.109004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170139-9275-429b-9d57-bb2edda33c50 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.109817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170139-9275-429b-9d57-bb2edda33c50 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.109948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5170139-9275-429b-9d57-bb2edda33c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.153394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c5170139-9275-429b-9d57-bb2edda33c50 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:54.155385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c5170139-9275-429b-9d57-bb2edda33c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:54.173377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 354/709] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:54 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:54.214928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcec26-3057-4b5a-9ab1-0e52a7cb1c99 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.235811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dcec26-3057-4b5a-9ab1-0e52a7cb1c99 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.242908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.244228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.244704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.245179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.265878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:54.279747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:54.282434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 356/710] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:54.293771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170139-9275-429b-9d57-bb2edda33c50 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.309584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5170139-9275-429b-9d57-bb2edda33c50 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.317113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a31926-2f8f-414b-a49d-6faffe52d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.318263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31926-2f8f-414b-a49d-6faffe52d710 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.318725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31926-2f8f-414b-a49d-6faffe52d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.319198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a31926-2f8f-414b-a49d-6faffe52d710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.320638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a31926-2f8f-414b-a49d-6faffe52d710 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:54.321519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a31926-2f8f-414b-a49d-6faffe52d710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.325052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a31926-2f8f-414b-a49d-6faffe52d710 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.342969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 355/711] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:54.353783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.371174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150bfdb-42c4-4040-a8dc-98e80e8eb4cb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.378896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.380265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.380744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.381219 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.409032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.412900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.439818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d4930-4226-4193-8477-eb04d0e97311 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.440315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d4930-4226-4193-8477-eb04d0e97311 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.440767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d4930-4226-4193-8477-eb04d0e97311 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.446678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 356/712] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:54 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:54.451598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d397-8d50-4023-88c4-ec7585e1b1f3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.452199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d397-8d50-4023-88c4-ec7585e1b1f3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.452935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53d397-8d50-4023-88c4-ec7585e1b1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.456717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:54.467732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 357/713] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:54.478187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.483762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fc53d397-8d50-4023-88c4-ec7585e1b1f3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:54.485829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fc53d397-8d50-4023-88c4-ec7585e1b1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:54.502551 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3cec6-0b9f-443c-9483-c109613c6f3e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.506524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 357/714] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:54 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:54.522604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.524170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.524941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.525707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.527339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:54.528143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.531457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d397-8d50-4023-88c4-ec7585e1b1f3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.541585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.552108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53d397-8d50-4023-88c4-ec7585e1b1f3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.567236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.568065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.568351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.568625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.571084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 358/715] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:54.581316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.588315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:54.596483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:54.604345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 358/716] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:54.605319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.608888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105686a8-ca5b-4011-8df1-831d086d57ef admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.620201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e29aa4-8362-43d8-90e6-36c4715a39bb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.625811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.627115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.627460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.627793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.627942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.628089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.628349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.628491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.629106 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:54.629411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.631091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.646992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 359/717] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:54.648455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.650091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.654454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.672733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff47477-6dff-4d8e-9697-5711cdc346bb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.684249 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:04:54.687576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 359/718] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:54.687768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.688495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.688859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.689160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.697061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.700831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.704195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.716894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a55c4e-c8b7-4a13-a761-164da4e439a9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.722113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:54.729506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 360/719] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:54.732795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.734384 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.735128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.735950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.737814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:54.738637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.743839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.746224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.759166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb554b8-3187-4c4b-851d-38f9112f9328 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.781834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.782522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.782818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.783103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.783836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:54.784177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.789286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 360/720] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:54.789811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.799582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.821934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 361/721] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:54.832627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.837336 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d5a3-fc0b-4b4c-b78e-55b7506c511e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.854984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.856626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.857365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.858303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.876781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76789-676e-4dd4-9acb-fabff22e05be admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.884519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.886415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.887208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.887901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.891319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.894859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.906573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.911540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.931185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 03:04:54.933171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 362/722] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:54.937500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 361/723] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:04:54.940391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.944455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:54.952002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495c23a-8b46-450d-96e9-f1084eece8fa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.957301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.958424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.958920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.959386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.960500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:54.961011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:54.963144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:54.964326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb75af1-324f-4af9-87dd-b979da014d0f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:54.983961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:54.985223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:54.985797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:54.986284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:54.989271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 363/724] 10.222.0.31 () {56 vars in 1170 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:55.002985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.017225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.019472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.022269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5a00f-5eb7-4059-a309-ebed8145c7b3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.033167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.036305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.036807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.037320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.060292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.061493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:55.063304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 362/725] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:55.063867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.073098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.104205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ffbf19-437e-4479-baa3-d24329e45a86 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.119643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.121673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.122144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.122615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.126074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.126607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.127967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:55.133493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.133651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 364/726] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:55.137592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.158925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 363/727] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:55.165366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed84bed-4107-4965-84a3-a6ef2d36a8cb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.170716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.182379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.183079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.183362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.183642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.184405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.184718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.187596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.189560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ada61-4b9f-4fa0-bb2d-dd9a2c95875a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.204887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 365/728] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:55.211761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.212070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.213651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.214116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.214478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.223105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c212c-4d33-404a-87c7-cad31bab44c4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.226235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.229677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.250418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.251242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.251522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.251798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.253845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:55.256131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 364/729] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:55.263678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.265929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.270308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.284064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1784bd5-78f1-4b79-882c-43f86f607998 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.302861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.304027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.304522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.304989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.306572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.307119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.310944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.318892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:55.321669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 366/730] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:55.329256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.335172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 365/731] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:55.348528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.353984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45252b51-8ae1-4615-8727-746fb5f0fa93 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.362211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecf014-1468-42b8-80d2-8a881b39618a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.368614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0164d67-0d60-4b02-b70e-24d20275ce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.369314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164d67-0d60-4b02-b70e-24d20275ce69 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.369630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164d67-0d60-4b02-b70e-24d20275ce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.369981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0164d67-0d60-4b02-b70e-24d20275ce69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.371539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0164d67-0d60-4b02-b70e-24d20275ce69 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.371853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0164d67-0d60-4b02-b70e-24d20275ce69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.374104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0164d67-0d60-4b02-b70e-24d20275ce69 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.376967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.377674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.377951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.378270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.379155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=cf258dbbf82147618bc5310aebd91a65) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.379465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.381387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.392165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 366/732] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/role_assignments?user.id=cf258dbbf82147618bc5310aebd91a65&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:55.408272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 367/733] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:55.416141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.435751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f609c9-3d36-43ea-a6a2-f019495cb8bc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.451610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6b893-4184-43a1-8b5e-52128e95c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.452582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6b893-4184-43a1-8b5e-52128e95c666 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.452871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6b893-4184-43a1-8b5e-52128e95c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.453152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6b893-4184-43a1-8b5e-52128e95c666 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/ee68d56c327f4e8eb32e019ea2326bfe/roles/b984563875e9456592cc79cc4869741d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.484501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6b893-4184-43a1-8b5e-52128e95c666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=ee68d56c327f4e8eb32e019ea2326bfe, role_id=b984563875e9456592cc79cc4869741d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.489467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6b893-4184-43a1-8b5e-52128e95c666 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.529102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 367/734] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:55 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/ee68d56c327f4e8eb32e019ea2326bfe/roles/b984563875e9456592cc79cc4869741d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:55.565238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00237-fe8a-4cac-9e4a-89ac2742d71c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.565638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00237-fe8a-4cac-9e4a-89ac2742d71c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.565818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00237-fe8a-4cac-9e4a-89ac2742d71c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.567742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 368/735] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:55.582049 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea43575-bb31-42c0-942a-00885ab87676 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.582547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea43575-bb31-42c0-942a-00885ab87676 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.583007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea43575-bb31-42c0-942a-00885ab87676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.623456 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cea43575-bb31-42c0-942a-00885ab87676 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:55.625623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cea43575-bb31-42c0-942a-00885ab87676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:55.722301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 368/736] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:55 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:55.746464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00237-fe8a-4cac-9e4a-89ac2742d71c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.761534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00237-fe8a-4cac-9e4a-89ac2742d71c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.768279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.769536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.769888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.770165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] PATH_INFO: `/v3/services/network` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.770876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.772171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:55.772171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:55.772171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:55.774956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.792486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 16 03:04:55.794248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 369/737] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:55.800696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea43575-bb31-42c0-942a-00885ab87676 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.811505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea43575-bb31-42c0-942a-00885ab87676 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.816721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641273aa-edfa-427b-93bd-e40f32e1acd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.817571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641273aa-edfa-427b-93bd-e40f32e1acd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.817921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641273aa-edfa-427b-93bd-e40f32e1acd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.818252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641273aa-edfa-427b-93bd-e40f32e1acd9 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.819086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641273aa-edfa-427b-93bd-e40f32e1acd9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.819460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641273aa-edfa-427b-93bd-e40f32e1acd9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.821690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641273aa-edfa-427b-93bd-e40f32e1acd9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.829780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 369/738] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:55.837582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.843374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3719-e7e7-4001-9013-1b4ed0734f4f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.843860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3719-e7e7-4001-9013-1b4ed0734f4f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.844316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a3719-e7e7-4001-9013-1b4ed0734f4f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.853477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 370/739] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:55 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:55.858149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6baf-26dd-418f-8669-31543a9b4537 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.858519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6baf-26dd-418f-8669-31543a9b4537 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.858951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b6baf-26dd-418f-8669-31543a9b4537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.859560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be89b0-2ac2-41f0-9f7c-84f591f9fe4d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.865105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.866347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.866983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.867470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.868552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] RBAC: Adding query filter params (type=network) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.869161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.872757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.880440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 370/740] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/services?type=network => generated 350 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:55.890315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.891874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-977b6baf-26dd-418f-8669-31543a9b4537 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:55.894002 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-977b6baf-26dd-418f-8669-31543a9b4537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:55.902312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de1913-2464-46ec-9710-b83de51f6a2a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.908637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.909834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.910023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 371/741] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:55 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:55.910545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.911405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.912567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] RBAC: Adding query filter params (interface=public, service_id=aef013675d9a49308355eea089bd2e0e, region_id=RegionOne) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:55.913103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.919525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:55.919525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:55.919525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:55.922001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.937290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 371/742] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/endpoints?service_id=aef013675d9a49308355eea089bd2e0e&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:55.946910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6baf-26dd-418f-8669-31543a9b4537 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.952253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:55.973809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b6baf-26dd-418f-8669-31543a9b4537 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.976148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412a049-d629-4808-990e-c6dfb79bd1f9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:55.981744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.982873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.983310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.983552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e3b4a-7206-4e78-ab35-88cca784cd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:55.984034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.985082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3b4a-7206-4e78-ab35-88cca784cd07 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:55.985196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.985666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3b4a-7206-4e78-ab35-88cca784cd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:55.986105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e3b4a-7206-4e78-ab35-88cca784cd07 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:55.987251 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e3b4a-7206-4e78-ab35-88cca784cd07 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:55.988381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:55.990253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e3b4a-7206-4e78-ab35-88cca784cd07 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.000272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 372/743] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/services => generated 772 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:56.009756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-bd2e3b4a-7206-4e78-ab35-88cca784cd07 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 16 03:04:56.012122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 372/744] 10.222.0.31 () {56 vars in 1150 bytes} [Tue Nov 16 03:04:55 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:56.030595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.048536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1771e7-15c4-4550-a9b4-5eebce913a42 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.056198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c53d96-85a6-4e18-a07f-f3b3fd79aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.057342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53d96-85a6-4e18-a07f-f3b3fd79aab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.057816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53d96-85a6-4e18-a07f-f3b3fd79aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.058238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c53d96-85a6-4e18-a07f-f3b3fd79aab9 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.059410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53d96-85a6-4e18-a07f-f3b3fd79aab9 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.059875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53d96-85a6-4e18-a07f-f3b3fd79aab9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.062994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c53d96-85a6-4e18-a07f-f3b3fd79aab9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.068729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ae997-b8a1-4d1a-9d44-1aa212cabae3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.069512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ae997-b8a1-4d1a-9d44-1aa212cabae3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.069984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ae997-b8a1-4d1a-9d44-1aa212cabae3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.072368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 373/746] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:56.072590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 373/746] 10.222.0.31 () {56 vars in 1145 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:56.083760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ae997-b8a1-4d1a-9d44-1aa212cabae3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.083999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5ea6-c1fa-404e-a718-25ce431c57b6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.084250 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5ea6-c1fa-404e-a718-25ce431c57b6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.084712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5ea6-c1fa-404e-a718-25ce431c57b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.105791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ae997-b8a1-4d1a-9d44-1aa212cabae3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.115894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bfcb5ea6-c1fa-404e-a718-25ce431c57b6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:56.118029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bfcb5ea6-c1fa-404e-a718-25ce431c57b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:56.118653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.119569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.120047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.120508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.121589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.122381 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.125665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.137847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 374/747] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:56 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:56.139716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 374/748] 10.222.0.31 () {56 vars in 1145 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:56.157191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb5ea6-c1fa-404e-a718-25ce431c57b6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.171937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb5ea6-c1fa-404e-a718-25ce431c57b6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.177006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.177793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.178076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.178399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.179244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] RBAC: Adding query filter params (interface=public, service_id=3b4e61325b03416cb0974fa33f3c681c, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.179564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.180716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:56.180716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:04:56.180716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:04:56.181707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.183881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.197287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785415c1-db89-4b11-94cf-d8f5051913b4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.209504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.211117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 375/749] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/endpoints?service_id=3b4e61325b03416cb0974fa33f3c681c&interface=public®ion_id=RegionOne => generated 194 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:56.211230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.211400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.211691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.220448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.238092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1551dff-5dd9-4bf1-b7bf-d8795b213cbc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.241605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:56.249773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:04:56.251650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 375/750] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:56.252259 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.253400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.253928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.254403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.255750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.259008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.263005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.286395 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 376/751] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/services => generated 772 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:56.301995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228923a-17af-4721-8746-0119ed74abbf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.312539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.313730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.314198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.314652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.316099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.316627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.319795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.346804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 376/752] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:56.357530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.379978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3bcfc-5239-4cbd-a083-de8dc30002c6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.393521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.394935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.395433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.395916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.436985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.440175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.467593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:56.469679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 377/753] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:56.478449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.489501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4ca23-0dc3-47a9-a473-ab3e3c1c1e6e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.496482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.497185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.497508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.497789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.498659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.499173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.501117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.526523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 377/754] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:56.536105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.551461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5b3b4-9bc9-4f67-a093-dba01c2393e4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.560946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.562176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.562678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.563137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.572532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.574996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.595822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 03:04:56.597824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 378/755] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:56.607739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.625619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5186735-c89e-440e-bf48-2198a76b771f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.637643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.638803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.639357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.639831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.641569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.642154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.645970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.685616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 378/756] 10.222.0.31 () {56 vars in 1156 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:56.691458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.707779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337973d8-7554-4955-a353-55aa7baa6ccb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.713923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.714742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.715016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.715284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.730339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.732641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.756577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:56.758587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 379/757] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:56.768431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.792190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d2be2-4688-491c-afa4-d891d2b56fde admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.810736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.812389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.813158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.813871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.815348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.816091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.819202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.854816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 379/758] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:56.864670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.879746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3e98-a352-4213-8a10-74fb2659c6ae admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.890425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.891258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.891536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.891804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.902479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.904474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:56.925088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:04:56.935017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 380/759] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:56.945485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:56.970249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f5dbe-ea3b-4855-8185-f8f8c5798c39 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:56.990691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fe0b5-f7f5-41e2-970c-f45bbbfd8424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:56.992289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fe0b5-f7f5-41e2-970c-f45bbbfd8424 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:56.993008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fe0b5-f7f5-41e2-970c-f45bbbfd8424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:56.993776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fe0b5-f7f5-41e2-970c-f45bbbfd8424 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:56.995408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fe0b5-f7f5-41e2-970c-f45bbbfd8424 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:56.996199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fe0b5-f7f5-41e2-970c-f45bbbfd8424 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:56.999745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9fe0b5-f7f5-41e2-970c-f45bbbfd8424 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:57.024828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 380/760] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:04:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:57.035648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:57.051038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db1f6c-8fa1-4d60-91d3-97cebe23eb62 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:57.065910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f705-e609-4785-8b6a-b3bc333db153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:57.066824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f705-e609-4785-8b6a-b3bc333db153 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:57.067102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f705-e609-4785-8b6a-b3bc333db153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:57.067371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f705-e609-4785-8b6a-b3bc333db153 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/b580550112ae4c51a3bffea61ede5bb2/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:57.069525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f705-e609-4785-8b6a-b3bc333db153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=b580550112ae4c51a3bffea61ede5bb2, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:57.072214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f705-e609-4785-8b6a-b3bc333db153 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:57.103820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 381/761] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:04:57 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/b580550112ae4c51a3bffea61ede5bb2/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:04:58.779150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e372f-1455-460d-a83b-03420853bfe2 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:58.780237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e372f-1455-460d-a83b-03420853bfe2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:58.780237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e372f-1455-460d-a83b-03420853bfe2 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:58.782102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 381/762] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:58.803882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2fe0-20d8-428c-bc97-d9518283dfc7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:58.804808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2fe0-20d8-428c-bc97-d9518283dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:58.804808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2fe0-20d8-428c-bc97-d9518283dfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:58.831966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b3ee2fe0-20d8-428c-bc97-d9518283dfc7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:58.833232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b3ee2fe0-20d8-428c-bc97-d9518283dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:58.928432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 382/763] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:58 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:04:58.996603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e372f-1455-460d-a83b-03420853bfe2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.016310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e372f-1455-460d-a83b-03420853bfe2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.025681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.026523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.026801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.027051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.047665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceef7d-d466-4835-aa44-75f9b5ee5acb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.048074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceef7d-d466-4835-aa44-75f9b5ee5acb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.048308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfceef7d-d466-4835-aa44-75f9b5ee5acb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.049939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 383/764] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:59.051145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:04:59.058476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:04:59.059998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 382/765] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:04:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:59.067176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1c2a-86e7-4896-9400-0269de56766a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.067538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1c2a-86e7-4896-9400-0269de56766a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.067782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f1c2a-86e7-4896-9400-0269de56766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.072138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.093273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b6421-6e21-44b8-8ce8-ede83ac587d3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.098920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-820f1c2a-86e7-4896-9400-0269de56766a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:59.100550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-820f1c2a-86e7-4896-9400-0269de56766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:59.106179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.106938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.107201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.107536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.108612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.109797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.111941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.119156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 384/766] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:59 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:59.133855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 383/767] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:59.145617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1c2a-86e7-4896-9400-0269de56766a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.152987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.164467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7a2db-4514-4e49-9e58-0a37521589f6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.172911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820f1c2a-86e7-4896-9400-0269de56766a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.179792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.181802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.182587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.183966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.186540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.190790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.197654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.199554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.200360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.201206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.235315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 16 03:04:59.243154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 384/768] 10.222.0.31 () {56 vars in 1153 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:59.250918 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.251625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.255642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.261710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cbf76f-ec67-41ba-a761-576eaf34cf07 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.269225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.269973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.270301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.273476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.273476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.273476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.273476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.284609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 385/769] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:59.286367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.296325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:59.297210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1df7af-b15a-49f6-9940-25dea2093c92 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.298000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 385/770] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:59.302298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.303046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.303327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.303600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.304420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.304724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.306504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.311003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.317714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 386/771] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:59.330883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52b9a3-5cc0-490b-84a0-5970ec82be8f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.346439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24c784-6966-4c22-b1c3-cff9975d7326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.347138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c784-6966-4c22-b1c3-cff9975d7326 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.347415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c784-6966-4c22-b1c3-cff9975d7326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.347689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24c784-6966-4c22-b1c3-cff9975d7326 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.348476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c784-6966-4c22-b1c3-cff9975d7326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.348777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c784-6966-4c22-b1c3-cff9975d7326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.350516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec24c784-6966-4c22-b1c3-cff9975d7326 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.368991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 386/772] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:04:59.379984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.384647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352919e-eec4-480a-ab32-3fb1aaf60e10 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.385044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352919e-eec4-480a-ab32-3fb1aaf60e10 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.385292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c352919e-eec4-480a-ab32-3fb1aaf60e10 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.387396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 387/773] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:04:59.394310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074e0b-7a2a-4e06-9ce0-61946f69fc8f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.394763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074e0b-7a2a-4e06-9ce0-61946f69fc8f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.394997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074e0b-7a2a-4e06-9ce0-61946f69fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.403471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b34aad-7846-43d4-a003-9a599aae2b33 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.417729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b25f3-a90e-4071-a7fe-46a4969ea59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.421393 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b25f3-a90e-4071-a7fe-46a4969ea59a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.422726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b25f3-a90e-4071-a7fe-46a4969ea59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.424639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b25f3-a90e-4071-a7fe-46a4969ea59a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.448268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-25074e0b-7a2a-4e06-9ce0-61946f69fc8f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:59.454141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-25074e0b-7a2a-4e06-9ce0-61946f69fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:59.458260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b25f3-a90e-4071-a7fe-46a4969ea59a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.464975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b25f3-a90e-4071-a7fe-46a4969ea59a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.487991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 388/774] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:59 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:04:59.512306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074e0b-7a2a-4e06-9ce0-61946f69fc8f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.519590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8f4b25f3-a90e-4071-a7fe-46a4969ea59a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 03:04:59.525468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 387/775] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:59.533079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074e0b-7a2a-4e06-9ce0-61946f69fc8f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.537505 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7648a-6007-4903-9b60-ccd13ec762ca None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.537505 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7648a-6007-4903-9b60-ccd13ec762ca None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.537505 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7648a-6007-4903-9b60-ccd13ec762ca None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.538895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 388/776] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:04:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:04:59.545987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2c30f-49a3-4d6c-b5ad-8c1f1b2adb6e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.546382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2c30f-49a3-4d6c-b5ad-8c1f1b2adb6e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.546546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2c30f-49a3-4d6c-b5ad-8c1f1b2adb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.549744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.551681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.552454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.553259 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.554971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.558788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.566691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a8c2c30f-49a3-4d6c-b5ad-8c1f1b2adb6e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:04:59.567952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a8c2c30f-49a3-4d6c-b5ad-8c1f1b2adb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:04:59.577482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 389/777] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:04:59 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:04:59.578367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2c30f-49a3-4d6c-b5ad-8c1f1b2adb6e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.584317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 16 03:04:59.586968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 389/778] 10.222.0.31 () {56 vars in 1150 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:04:59.594023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.596771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2c30f-49a3-4d6c-b5ad-8c1f1b2adb6e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.603006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.603933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec2207-26fd-4cb0-85e2-e62af6d06e3c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.604153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.604446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.604822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.605788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.606183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.609020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.610010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.610711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.611133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.611231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.611929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.612937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.614293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.619091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 390/779] 10.222.0.31 () {56 vars in 1145 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:59.619941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.631818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 390/780] 10.222.0.31 () {56 vars in 1170 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:59.632748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.635124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a567e-f826-4fc4-9cad-cf3b0c923348 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.640269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.641284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.641392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.641658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.642308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.643925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.645147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a0b95-b1ca-493b-af5f-83924392e2c4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.650870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.651601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.651880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.652195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.652980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.653287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.655521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.655775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 16 03:04:59.657307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 391/781] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services/network => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:59.658181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.662827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 391/782] 10.222.0.31 () {56 vars in 1145 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:59.665717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.673980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab92cb-50c5-4197-9c30-505f482615d4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.679596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.680257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.680433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6cfa7-d26e-4fbd-9745-94be8134fe8e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.680590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.680786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.685502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.687595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.687901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.688178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.688930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] RBAC: Adding query filter params (name=network) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.689554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.690276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.691200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.692160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.696713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 392/783] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:59.697806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.703715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 392/784] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:04:59.704875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.709836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12573a-b9df-42f6-b8c3-f133723a1cad admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.715740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a7db47-7310-41f7-8fb4-fbde6099bcc4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.716043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.716557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.716850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.717181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.718690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.719827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:04:59.719827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:04:59.719827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:04:59.720824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.721336 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.722126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.722499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.722838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.723738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:04:59.724099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.726664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.733824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 393/785] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:04:59.735540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.750178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 393/786] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:04:59 2021] POST /identity/v3/endpoints => generated 346 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:04:59.754042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:04:59.766964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd678ab-04a4-4066-a11a-d3a08f1e5c00 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.850744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b3543d-af0d-401e-92d9-59ac5e9b4ecf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:04:59.867925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.869332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.869794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.871037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.873306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:04:59.875306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.876755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:04:59.877363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:04:59.879571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.880390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:04:59.917832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:04:59.922298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:04:59.945697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 394/787] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:04:59 2021] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:04:59.967607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:04:59.970283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 394/788] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:04:59.981357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.018985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495d517-7811-45aa-ae67-2e94b0ce0c98 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.027282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.027664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.027972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.028389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.030036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:00.030518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:00.033453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:00.057171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 395/789] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:04:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:00.068207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.085170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8bd6c-d65e-4b89-ac07-26ae9a3941b5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.092924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.094365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.094776 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.095248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.108635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:00.112448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:00.135813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:00.137899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 395/790] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:00.149265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.163311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b72d1-1cb8-43cf-b2f5-e6d6bd36cd60 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.172337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635f20f-4ae0-4e23-bf72-98ee988ab732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.173077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f20f-4ae0-4e23-bf72-98ee988ab732 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.173358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f20f-4ae0-4e23-bf72-98ee988ab732 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.173661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635f20f-4ae0-4e23-bf72-98ee988ab732 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.174542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f20f-4ae0-4e23-bf72-98ee988ab732 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:00.174845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f20f-4ae0-4e23-bf72-98ee988ab732 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:00.176839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4635f20f-4ae0-4e23-bf72-98ee988ab732 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:00.193338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 396/791] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:00.204465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.216343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaaa7f7-1505-42b4-8946-65ae179750e4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.222596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ee210-85f1-4288-b68d-5d714a59294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.223291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee210-85f1-4288-b68d-5d714a59294d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.223577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee210-85f1-4288-b68d-5d714a59294d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.223847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ee210-85f1-4288-b68d-5d714a59294d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.224696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ee210-85f1-4288-b68d-5d714a59294d admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=ee68d56c327f4e8eb32e019ea2326bfe) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:00.225022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ee210-85f1-4288-b68d-5d714a59294d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:00.226994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ee210-85f1-4288-b68d-5d714a59294d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:00.238992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 396/792] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:00 2021] GET /identity/v3/role_assignments?user.id=ee68d56c327f4e8eb32e019ea2326bfe&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:00.651976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584ad9-727a-47d2-bcf5-eec007cb15cc None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.652357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584ad9-727a-47d2-bcf5-eec007cb15cc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.652541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98584ad9-727a-47d2-bcf5-eec007cb15cc None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.654779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 397/793] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:00.661677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855e17-b26a-4775-99e4-18cdb8ff5a0e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.661960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855e17-b26a-4775-99e4-18cdb8ff5a0e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.662234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92855e17-b26a-4775-99e4-18cdb8ff5a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.682051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-92855e17-b26a-4775-99e4-18cdb8ff5a0e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:00.683273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-92855e17-b26a-4775-99e4-18cdb8ff5a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:00.691819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 397/794] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:00 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:00.736806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98584ad9-727a-47d2-bcf5-eec007cb15cc None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.757831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98584ad9-727a-47d2-bcf5-eec007cb15cc None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.766779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.768757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.769586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.770395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.793746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:00.807908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:05:00.811114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 398/795] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:00.823036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92855e17-b26a-4775-99e4-18cdb8ff5a0e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.840060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92855e17-b26a-4775-99e4-18cdb8ff5a0e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.848215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.849419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.849935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.850445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.851906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:00.852453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:00.855656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:00.873396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 398/796] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:00.883678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.902240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac775353-5818-4401-aec0-8b234201e71e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.910205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.911633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.912127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.912669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.932724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:00.936242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:00.970713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:00.973402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 399/797] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:00.979959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:00.991771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a41d6-4a76-46a1-b1b0-c92909a73b0c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:00.996529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:00.997199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:00.997497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:00.997770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:00.998719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:00.999006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.000516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.014918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 399/798] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:01.021340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.032201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50a43e-9ef2-4a13-9d54-67487afb0d93 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.037669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.038562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.038845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.039110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.048535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.050645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.080539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 16 03:05:01.083229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 400/799] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:01.089270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.099769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ccbfe-d554-4e0f-993e-d76bd7a2d980 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.104586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.105306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.105626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.105987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.106884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:01.107192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.109254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.141270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 400/800] 10.222.0.31 () {56 vars in 1156 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:01.147465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.158450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682023a-28f9-4433-8120-7742346d8d5f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.163655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.164353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.164638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.164908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.174553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.176421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.187511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 401/801] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:01.194635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.211014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5a9f6-f4a0-44a8-8cc3-58e2c0da44c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.218377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.219674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.220149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.220561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.238752 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.242054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.275615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:01.278100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 401/802] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:01.284369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.294504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7ee66-d023-4a1d-8d75-729f47b29d45 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.299563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.300253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.300531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.300802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.301597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:01.301901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.303636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.318716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 402/803] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:01.325751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.339007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588edcd5-6b32-434f-a865-0fb76fd5b3fd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.344769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.346075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.346536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.346974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.355733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.358300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.373611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:01.375683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 402/804] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:01.382602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.393929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d2d960-93f3-4cdd-99ed-8ae5f730a23d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.399187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d3635-d32a-4e51-baa5-641357f51b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.400194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3635-d32a-4e51-baa5-641357f51b7c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.400694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3635-d32a-4e51-baa5-641357f51b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.401137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d3635-d32a-4e51-baa5-641357f51b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.402219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3635-d32a-4e51-baa5-641357f51b7c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:01.402725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3635-d32a-4e51-baa5-641357f51b7c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.405167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d3635-d32a-4e51-baa5-641357f51b7c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.423975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 403/805] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:01.430623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:01.442555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65320c2e-3358-4ded-8071-a923b0c30c47 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:01.447924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe23a9-75f5-4bba-9311-677cbd58587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:01.448967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe23a9-75f5-4bba-9311-677cbd58587c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:01.449487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe23a9-75f5-4bba-9311-677cbd58587c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:01.449957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe23a9-75f5-4bba-9311-677cbd58587c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:01.451034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe23a9-75f5-4bba-9311-677cbd58587c admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=b580550112ae4c51a3bffea61ede5bb2) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:01.451848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe23a9-75f5-4bba-9311-677cbd58587c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:01.454051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe23a9-75f5-4bba-9311-677cbd58587c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:01.463373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 403/806] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:01 2021] GET /identity/v3/role_assignments?user.id=b580550112ae4c51a3bffea61ede5bb2&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:02.023527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24ee8e-e4ab-49de-9caa-e42f358979b4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.025106 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24ee8e-e4ab-49de-9caa-e42f358979b4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.025856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24ee8e-e4ab-49de-9caa-e42f358979b4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.030024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 404/807] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:02 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:02.042193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054058b-48c5-4691-92f0-2ec8eb3efe7d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.043733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054058b-48c5-4691-92f0-2ec8eb3efe7d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.044530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054058b-48c5-4691-92f0-2ec8eb3efe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.078224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4054058b-48c5-4691-92f0-2ec8eb3efe7d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:02.080864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4054058b-48c5-4691-92f0-2ec8eb3efe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:02.094854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 404/808] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:02 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:02.139246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24ee8e-e4ab-49de-9caa-e42f358979b4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:02.162386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24ee8e-e4ab-49de-9caa-e42f358979b4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:02.170315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a56a09-dd90-4994-9aa9-7cb82336f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:02.171885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56a09-dd90-4994-9aa9-7cb82336f4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.172647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56a09-dd90-4994-9aa9-7cb82336f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.173392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a56a09-dd90-4994-9aa9-7cb82336f4e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.175433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56a09-dd90-4994-9aa9-7cb82336f4e4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:02.179173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a56a09-dd90-4994-9aa9-7cb82336f4e4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:02.207621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 405/809] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:05:02 2021] POST /identity/v3/services => generated 269 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:02.816718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2e269-d9da-43d5-9ff8-eb1f6dc9d5cf None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.817186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2e269-d9da-43d5-9ff8-eb1f6dc9d5cf None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.817344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a2e269-d9da-43d5-9ff8-eb1f6dc9d5cf None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.819688 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 405/810] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:02.833270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1e78-b9e9-443d-84fe-64f27be8afcd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.834111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1e78-b9e9-443d-84fe-64f27be8afcd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.834866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac1e78-b9e9-443d-84fe-64f27be8afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.867250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-68ac1e78-b9e9-443d-84fe-64f27be8afcd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:02.869682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-68ac1e78-b9e9-443d-84fe-64f27be8afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:02.907139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 406/811] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:02 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:02.930458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2e269-d9da-43d5-9ff8-eb1f6dc9d5cf None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:02.943544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a2e269-d9da-43d5-9ff8-eb1f6dc9d5cf None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:02.948173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:02.948990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.949269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.949582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.950267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:02.951942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:02.960924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30431d7-7363-476a-9b76-0218e86817ab None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.961195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30431d7-7363-476a-9b76-0218e86817ab None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.961583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30431d7-7363-476a-9b76-0218e86817ab None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.963632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 407/812] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:02.963912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 16 03:05:02.965494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 406/813] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:02 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:02.970919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8354e4-c298-42c4-9136-4a8a61c9f879 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.971297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8354e4-c298-42c4-9136-4a8a61c9f879 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.971858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8354e4-c298-42c4-9136-4a8a61c9f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.972663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:02.983584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e11f9-2feb-438d-8419-7ee6a6beeaee admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:02.988343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:02.989019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:02.989299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:02.989609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:02.990345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:02.990651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:02.991846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4e8354e4-c298-42c4-9136-4a8a61c9f879 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:02.992274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:02.993059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4e8354e4-c298-42c4-9136-4a8a61c9f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:02.997833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 407/814] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:02 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:03.005533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 408/815] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:02 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:03.008402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.018516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfeee07-eaec-4aab-baef-294bbc9d5a07 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.023133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.023798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.024077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.024353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.025086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:03.025388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.027054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.028336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8354e4-c298-42c4-9136-4a8a61c9f879 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.035609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 408/816] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:03.044163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8354e4-c298-42c4-9136-4a8a61c9f879 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.050154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.051411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.051990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.052508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.066896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:03.074958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 03:05:03.081601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 409/817] 10.222.0.31 () {56 vars in 1141 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:03.084757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.096589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69307921-1fdd-46f4-903d-1324adc7741e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.102121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.103362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.103901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.104387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.105504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:03.106061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.108296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.124955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 409/818] 10.222.0.31 () {56 vars in 1136 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:03.126807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.138124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c071f-1320-49a2-9f01-25901cc8f734 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.143814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.145091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.145628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.146160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.159702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.162481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.182512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:03.189607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 410/819] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:03.192096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.203412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133d938-6a82-439c-b118-00b534b28136 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.208871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.210035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.210610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.211105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.212137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:03.212679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.214718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.233654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 410/820] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:03.236590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.248473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476a455-0173-4a3d-b470-f43db068d72a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.254539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.255767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.256263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.256741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.267243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.269775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.300911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 03:05:03.303547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 411/821] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:03.309997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.321007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d594d-5c21-4839-a5d8-273bde819d53 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.326177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.327716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.328247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.328719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.329865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:03.330416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.332526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.357631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 411/822] 10.222.0.31 () {56 vars in 1170 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:03.360733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.373769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e0fad-6b4b-4959-99bd-0924f3d8a3ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.379873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.381024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.381552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.382340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.392630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.394907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.412099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 412/823] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:05:03.418665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.429843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22801369-a0d3-4be4-994c-ec3c688e9e40 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.434740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.436046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.436642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.437132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.448548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.450788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.470704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:03.477592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 412/824] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:03.479884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.490752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d7a42-6582-495e-a704-881373216a08 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.495990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.497104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.497677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.498148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.499616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:03.500200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.502104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.520080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 413/825] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:03.526484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.538150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da13f9a-986a-4e1c-bc6f-cf12130c62c3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.543191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.544370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.544845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.545591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.555794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.558383 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.574633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:03.581567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 413/826] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:03.583927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.595280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52652ec8-fec4-44c3-a323-bf88984bacb2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.600288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb9000-0709-472d-8d23-96806ca1ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.601313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9000-0709-472d-8d23-96806ca1ce8d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.601825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9000-0709-472d-8d23-96806ca1ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.602340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb9000-0709-472d-8d23-96806ca1ce8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.603348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb9000-0709-472d-8d23-96806ca1ce8d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:03.603862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb9000-0709-472d-8d23-96806ca1ce8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.606073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb9000-0709-472d-8d23-96806ca1ce8d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.625440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 414/827] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:03.628374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:03.640014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a9b26-4519-45b1-b9b3-b0709c1ac8a3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:03.645004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27360-bf35-4a9d-9767-e743fcb85389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:03.646024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27360-bf35-4a9d-9767-e743fcb85389 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.646516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27360-bf35-4a9d-9767-e743fcb85389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.646987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27360-bf35-4a9d-9767-e743fcb85389 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.648120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27360-bf35-4a9d-9767-e743fcb85389 admin admin] RBAC: Adding query filter params (role.id=2d69a9c6be9d41cdb97f566f3bc77f75, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=ee68d56c327f4e8eb32e019ea2326bfe) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:03.648635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27360-bf35-4a9d-9767-e743fcb85389 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:03.650859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27360-bf35-4a9d-9767-e743fcb85389 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:03.661565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 414/828] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/role_assignments?user.id=ee68d56c327f4e8eb32e019ea2326bfe&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=2d69a9c6be9d41cdb97f566f3bc77f75 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:03.905070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337f71-c32b-4b1d-b721-4f0d4527a0f2 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.905372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337f71-c32b-4b1d-b721-4f0d4527a0f2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.905752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f337f71-c32b-4b1d-b721-4f0d4527a0f2 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.907811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 415/829] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:03.915246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c6774-8d8a-46db-8584-dd4c608362e0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:03.915498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c6774-8d8a-46db-8584-dd4c608362e0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:03.915808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c6774-8d8a-46db-8584-dd4c608362e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:03.935495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-268c6774-8d8a-46db-8584-dd4c608362e0 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:03.936795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-268c6774-8d8a-46db-8584-dd4c608362e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:03.945573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 415/830] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:03 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:03.988339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f337f71-c32b-4b1d-b721-4f0d4527a0f2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:04.010043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f337f71-c32b-4b1d-b721-4f0d4527a0f2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:04.017556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:04.018980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:04.019474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:04.019949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:04.021210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:04.024356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:04.047365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 03:05:04.049987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 416/831] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:03 2021] GET /identity/v3/services/object-store => generated 93 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:04.061966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c6774-8d8a-46db-8584-dd4c608362e0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:04.079142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c6774-8d8a-46db-8584-dd4c608362e0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:04.086739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d0f9d-1ad1-4e61-9d68-db14f83ba75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:04.087808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d0f9d-1ad1-4e61-9d68-db14f83ba75f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:04.088310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d0f9d-1ad1-4e61-9d68-db14f83ba75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:04.088787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d0f9d-1ad1-4e61-9d68-db14f83ba75f admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:04.090213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d0f9d-1ad1-4e61-9d68-db14f83ba75f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:04.090897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d0f9d-1ad1-4e61-9d68-db14f83ba75f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:04.094115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d0f9d-1ad1-4e61-9d68-db14f83ba75f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:04.103773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 416/832] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:04 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:04.115338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:04.134003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32771243-8497-4205-ba65-36b3704402a3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:04.142297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5118718-e94d-45b2-80ed-e80e84fa52de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:04.143558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5118718-e94d-45b2-80ed-e80e84fa52de admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:04.144055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5118718-e94d-45b2-80ed-e80e84fa52de admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:04.144568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5118718-e94d-45b2-80ed-e80e84fa52de admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:04.146026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5118718-e94d-45b2-80ed-e80e84fa52de admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:04.146566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5118718-e94d-45b2-80ed-e80e84fa52de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:04.149750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5118718-e94d-45b2-80ed-e80e84fa52de admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:04.159735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 417/833] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:04 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:05.348174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df718ed-74d0-4d61-b737-4bb2a26afca5 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.349236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df718ed-74d0-4d61-b737-4bb2a26afca5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.349758 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df718ed-74d0-4d61-b737-4bb2a26afca5 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.353572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 417/834] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:05:05.359823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4327d-8a80-462f-ad22-8a234b7ced23 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.360814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4327d-8a80-462f-ad22-8a234b7ced23 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.361314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4327d-8a80-462f-ad22-8a234b7ced23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.389504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c8a4327d-8a80-462f-ad22-8a234b7ced23 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:05.391915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c8a4327d-8a80-462f-ad22-8a234b7ced23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:05.405953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 418/835] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:05 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:05.431313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df718ed-74d0-4d61-b737-4bb2a26afca5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:05.445729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df718ed-74d0-4d61-b737-4bb2a26afca5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:05.450968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:05.452775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.453405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.453935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.454930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:05.456932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:05.460881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984630-6001-4079-8751-fc6305ed69df None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.461358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984630-6001-4079-8751-fc6305ed69df None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.461866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984630-6001-4079-8751-fc6305ed69df None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.466226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 419/836] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:05 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:05.472151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 16 03:05:05.472864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aea5d-2fb4-4498-a511-81b90adfe00f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.473153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aea5d-2fb4-4498-a511-81b90adfe00f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.473454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51aea5d-2fb4-4498-a511-81b90adfe00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.480010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 418/837] 10.222.0.31 () {56 vars in 1153 bytes} [Tue Nov 16 03:05:05 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:05.482382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:05.495419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9cf03-b687-4010-b4b2-8519f6cdeca7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:05.501185 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:05.502334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.502879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.503365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.504352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:05.504901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:05.506889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:05.512261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b51aea5d-2fb4-4498-a511-81b90adfe00f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:05.517468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b51aea5d-2fb4-4498-a511-81b90adfe00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:05.517675 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 419/838] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:05 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:05.521907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:05.528762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 420/839] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:05 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:05.541179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe739-d84e-4b25-9665-027e0d50fcaf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:05.549718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:05.550859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.551331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.551764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.553077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:05.553641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:05.553919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aea5d-2fb4-4498-a511-81b90adfe00f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:05.556767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:05.565030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51aea5d-2fb4-4498-a511-81b90adfe00f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:05.573471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 420/840] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:05 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:05.575978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:05.577099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60fd51-eb6d-4f05-a48b-32e58be51576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:05.578492 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60fd51-eb6d-4f05-a48b-32e58be51576 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.579127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60fd51-eb6d-4f05-a48b-32e58be51576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.579727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60fd51-eb6d-4f05-a48b-32e58be51576 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.581339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60fd51-eb6d-4f05-a48b-32e58be51576 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:05.584628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e60fd51-eb6d-4f05-a48b-32e58be51576 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:05.588406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d205681-d9a6-4429-8b94-6e7c3cd4f78a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:05.594806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:05.595555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.595859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.596114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.597018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] RBAC: Adding query filter params (interface=public, service_id=d0721cc639af462f98876627620ceebf, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:05.597314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:05.599284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:05.610126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 421/841] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:05:05 2021] GET /identity/v3/endpoints?service_id=d0721cc639af462f98876627620ceebf&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:05.615885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 421/842] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:05:05 2021] POST /identity/v3/services => generated 251 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:05:05.618132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:05.638536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd444591-4310-4873-922e-9b8e7edfcc7a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:05.667478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8506dd-e787-44dd-b9cd-a2108ce16bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:05.668686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8506dd-e787-44dd-b9cd-a2108ce16bba admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:05.669194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8506dd-e787-44dd-b9cd-a2108ce16bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:05.669739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8506dd-e787-44dd-b9cd-a2108ce16bba admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:05.671618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8506dd-e787-44dd-b9cd-a2108ce16bba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:05.675088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8506dd-e787-44dd-b9cd-a2108ce16bba admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:05.689033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 422/843] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:05:05 2021] GET /identity/v3/services => generated 1268 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:05:06.055980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383288-0baa-4f50-bb67-5c0539e4ee6e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.056380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383288-0baa-4f50-bb67-5c0539e4ee6e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.056516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d383288-0baa-4f50-bb67-5c0539e4ee6e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.058606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 422/844] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:06.065688 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d634d-dcfd-4cc6-bb92-e43063c54fc6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.065979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d634d-dcfd-4cc6-bb92-e43063c54fc6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.066227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d634d-dcfd-4cc6-bb92-e43063c54fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.085193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7b1d634d-dcfd-4cc6-bb92-e43063c54fc6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:06.086439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7b1d634d-dcfd-4cc6-bb92-e43063c54fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:06.094600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 423/845] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:06 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:06.118825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d383288-0baa-4f50-bb67-5c0539e4ee6e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.139960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d383288-0baa-4f50-bb67-5c0539e4ee6e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.147138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.148599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.149087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.149605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.168437 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:06.183534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 03:05:06.186366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 423/846] 10.222.0.31 () {56 vars in 1141 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:06.192492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d634d-dcfd-4cc6-bb92-e43063c54fc6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.202092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d634d-dcfd-4cc6-bb92-e43063c54fc6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.206729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.207393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.207668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.207935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.208704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:06.209006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.210640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.220081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 424/847] 10.222.0.31 () {56 vars in 1136 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:06.226572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.237907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61cd9e0-bfe8-4489-8614-e7e2df9d1acc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.244477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.245789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.246335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.246830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.259886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.262206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.281826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:06.283901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 424/848] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:06.290473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.306363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e585f-b89e-411a-ae17-b0e3b14ec6f4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.314468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.315641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.316116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.316632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.318077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:06.318596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.321760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.345044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 425/849] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:06.350881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.363356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0735b2b-5e89-4cb1-ad2e-cbb0c76a7495 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.368847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.370006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.370531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.370993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.380443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.382952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.397996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 03:05:06.399863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 425/850] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:06.406666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.418100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7fec56-fd01-43f9-b604-f65a2e963f78 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.423379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.424397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.424869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.425333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.426444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:06.426987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.429109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.450509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 426/851] 10.222.0.31 () {56 vars in 1170 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:06.458272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.471929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bdd0-ce7f-410e-a561-14e4c6c2332c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.476985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.478171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.478687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.479162 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.491825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.494136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.511656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:06.513642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 426/852] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:06.524012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.535439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3699fa-396a-46a6-a80e-36c1d8b6c70f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.541209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.542319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.542795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.543324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.544306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:06.544864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.547117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.560887 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 427/853] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:06.568693 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.582913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39cb38-21bc-48a4-b008-2d0fabfeb534 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.587969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.589147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.589713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.590263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.598478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.600880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.616609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:06.618616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 427/854] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:06.625930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.638523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761940c-8315-4bdb-a8de-262c7c3121ad admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.644130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7c368-8de4-4be4-b602-c047c803dc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.644803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c368-8de4-4be4-b602-c047c803dc97 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.645084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c368-8de4-4be4-b602-c047c803dc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.645356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7c368-8de4-4be4-b602-c047c803dc97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.646244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c368-8de4-4be4-b602-c047c803dc97 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:06.646630 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c368-8de4-4be4-b602-c047c803dc97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.648560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7c368-8de4-4be4-b602-c047c803dc97 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.667694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 428/855] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:06.675217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:06.686104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecedd4f6-710b-46eb-95d5-80d5c9c1a151 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:06.691538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8418952-8bd8-441f-ab2e-3428b3839448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:06.692847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8418952-8bd8-441f-ab2e-3428b3839448 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:06.693328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8418952-8bd8-441f-ab2e-3428b3839448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:06.693870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8418952-8bd8-441f-ab2e-3428b3839448 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/ee68d56c327f4e8eb32e019ea2326bfe/roles/2d69a9c6be9d41cdb97f566f3bc77f75` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:06.696592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8418952-8bd8-441f-ab2e-3428b3839448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=ee68d56c327f4e8eb32e019ea2326bfe, role_id=2d69a9c6be9d41cdb97f566f3bc77f75)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:06.699712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8418952-8bd8-441f-ab2e-3428b3839448 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:06.717816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 428/856] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:05:06 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/ee68d56c327f4e8eb32e019ea2326bfe/roles/2d69a9c6be9d41cdb97f566f3bc77f75 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:05:07.530012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef5c3-10a8-40e5-9bef-3cace93b6962 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:07.530599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef5c3-10a8-40e5-9bef-3cace93b6962 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:07.530990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef5c3-10a8-40e5-9bef-3cace93b6962 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:07.533347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 429/857] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:07.540926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edd041-ae01-482a-831b-2950888a6b02 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:07.541422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edd041-ae01-482a-831b-2950888a6b02 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:07.541520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edd041-ae01-482a-831b-2950888a6b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:07.560588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-24edd041-ae01-482a-831b-2950888a6b02 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:07.562241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-24edd041-ae01-482a-831b-2950888a6b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:07.624432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 429/858] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:07 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:07.648718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef5c3-10a8-40e5-9bef-3cace93b6962 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:07.662362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef5c3-10a8-40e5-9bef-3cace93b6962 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:07.666771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3a242-539c-4dcd-a3bd-ef51fea29a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:07.667435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3a242-539c-4dcd-a3bd-ef51fea29a60 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:07.667711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3a242-539c-4dcd-a3bd-ef51fea29a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:07.667983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3a242-539c-4dcd-a3bd-ef51fea29a60 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:07.668750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3a242-539c-4dcd-a3bd-ef51fea29a60 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:07.670633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3a242-539c-4dcd-a3bd-ef51fea29a60 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:07.691980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 430/859] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:05:07 2021] POST /identity/v3/services => generated 241 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:05:09.138421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a219-62b4-4b45-b53d-70e717fbfe5f None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.139615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a219-62b4-4b45-b53d-70e717fbfe5f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.140201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f6a219-62b4-4b45-b53d-70e717fbfe5f None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.142744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 430/860] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:09.150000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd3b7-8f9b-44df-aba4-dc605c144029 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.150972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd3b7-8f9b-44df-aba4-dc605c144029 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.151466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fd3b7-8f9b-44df-aba4-dc605c144029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.173242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4c4fd3b7-8f9b-44df-aba4-dc605c144029 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:09.175752 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4c4fd3b7-8f9b-44df-aba4-dc605c144029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:09.208135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 431/861] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:09 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:09.215443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737d4d-df77-440c-b20c-ab4d5758011d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.216387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737d4d-df77-440c-b20c-ab4d5758011d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.217230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a737d4d-df77-440c-b20c-ab4d5758011d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.221409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 431/862] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:09 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:09.223990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272013c-9d2c-4dd1-b0ce-e5c82bb28ae5 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.224297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272013c-9d2c-4dd1-b0ce-e5c82bb28ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.224549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272013c-9d2c-4dd1-b0ce-e5c82bb28ae5 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.231747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 432/863] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:05:09.234487 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4f915-d59d-47ce-a56b-9adfce8b0067 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.234893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4f915-d59d-47ce-a56b-9adfce8b0067 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.235332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4f915-d59d-47ce-a56b-9adfce8b0067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.237928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced412e-0a13-45d2-84b1-869fe26381f7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.238291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced412e-0a13-45d2-84b1-869fe26381f7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.238536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced412e-0a13-45d2-84b1-869fe26381f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.258328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bced412e-0a13-45d2-84b1-869fe26381f7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:09.259574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bced412e-0a13-45d2-84b1-869fe26381f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:09.267882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 433/864] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:09 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:09.268681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-38c4f915-d59d-47ce-a56b-9adfce8b0067 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:09.268860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced412e-0a13-45d2-84b1-869fe26381f7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.271316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-38c4f915-d59d-47ce-a56b-9adfce8b0067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:09.279241 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced412e-0a13-45d2-84b1-869fe26381f7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.284240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.285099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.285354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.286030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.297472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 432/865] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:09 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:09.304294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:09.311973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 03:05:09.312265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4f915-d59d-47ce-a56b-9adfce8b0067 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.313566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 434/866] 10.222.0.31 () {56 vars in 1141 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:09.326572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.327760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4f915-d59d-47ce-a56b-9adfce8b0067 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.332666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.333537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.333819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.334090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.334801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.337054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.346584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa62736-2004-4f89-9bf0-0902c9eb2061 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.349909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 16 03:05:09.357591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 433/867] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:09.357591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.362293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.363327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68638a90-9191-4033-9188-34d59de80d6e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.363487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.363820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.364414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.366022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.366547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.368408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.369241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.369569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.369730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.369866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.370513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.372368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.384711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 16 03:05:09.386456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 434/868] 10.222.0.31 () {56 vars in 1153 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:09.387026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.393168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 435/869] 10.222.0.31 () {56 vars in 1136 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:09.398253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.403596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f5ab6-3b12-451e-9996-6c0be6ff4cdc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.411054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.412041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.412442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.412844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.413780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.414215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.414775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c6203-c356-4ff5-895e-f774337d1d14 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.416313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.422896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.423714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 435/870] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:09.424016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.424269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.434135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.434135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.434135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.434135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.434135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.438903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 436/871] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:09.440278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9861a1-d891-4875-a281-6717b235e3d3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.441583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.445003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.445838 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.446115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.446385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.458379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.460241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.461846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c99bbd-bab3-4173-90db-817b07d7a2ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.468661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.470078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.470704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.471210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.472431 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.472985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.475306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.485900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 437/872] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:09.487901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.489948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:09.492524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 436/873] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:09.496663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.509860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9b6e3-607e-476e-9570-264a4f109cda admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.510933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376a007-493c-4503-8d76-cbd8ab9c7ee8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.515906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.516786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.517225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.517682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.518754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] RBAC: Adding query filter params (interface=public, service_id=dd4e6c3d89ee472abebdd3299d66c50e, region_id=RegionOne) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.519189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.519351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.520380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.520876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.521404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.521667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.522861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.523382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.526828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.529710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 437/874] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/endpoints?service_id=dd4e6c3d89ee472abebdd3299d66c50e&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:09.534543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.535417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 438/875] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:09.547447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.549573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc07d55-9022-475a-b3b1-8666185d1563 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.557280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.559349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.559776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.560452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.562588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.563096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.564667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1e1a01-dcd2-4311-8534-2c0346835d4a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.566053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.571807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.572892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.573341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.573827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.575107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.578266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.593636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 438/876] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:09.593921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 439/876] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/services => generated 1497 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:05:09.593921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.600700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.617499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5626-e0c9-4825-bde5-57583c7bda0f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.622053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86c47c-9b53-42f8-a184-cf6cf29151cf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.624937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.626082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.626590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.627009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.628428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.630317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:05:09.630317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:05:09.630317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:05:09.632525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.633390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.635227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.636005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.636717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.655073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.659643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.675460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 440/877] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:05:09 2021] POST /identity/v3/endpoints => generated 347 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:09.688034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 16 03:05:09.690987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 439/878] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:09.701787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.739224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bde15-0dc0-4309-a148-265e5f68713a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.748680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.750112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.750552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.750986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.752616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:09.753128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.756663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.794438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 441/879] 10.222.0.31 () {56 vars in 1170 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:09.805314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.822138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e924e9-69fd-4844-8298-b51626bd8672 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.840456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.841649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.842184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.842654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.858199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.861599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.879883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 440/880] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/auth/tokens => generated 1952 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:09.890647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.909367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab49eb5-6e48-4fbb-a939-40902bbc3b71 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:09.917324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:09.918749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:09.919202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:09.919664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:09.939698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:09.943082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:09.974155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:09.975783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 442/882] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:09.983961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:09.997323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96596fec-d493-4dd5-9cb6-942dfc0972eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.004642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.006310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.006834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.007347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.008348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:10.008941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.011094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.028258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 441/883] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:10.035658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.048292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d2b15-27ef-428a-9ce1-9fe58487f0fd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.054171 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.055337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.055761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.056191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.064918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.067297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.081975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:10.083947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 443/884] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:10.091999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.103091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df7643-fd32-432b-a332-0ad1b06b2645 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.109230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36567f28-8028-4291-ba1b-68a479965abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.110181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36567f28-8028-4291-ba1b-68a479965abf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.110666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36567f28-8028-4291-ba1b-68a479965abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.111083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36567f28-8028-4291-ba1b-68a479965abf admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.112071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36567f28-8028-4291-ba1b-68a479965abf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:10.112522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36567f28-8028-4291-ba1b-68a479965abf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.114735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36567f28-8028-4291-ba1b-68a479965abf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.128800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 442/885] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:10.135407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.147163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1dd4b3-487d-4e73-b8f2-7bcaef59a72a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.152073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500db9d-94eb-4233-b18a-56bca8244f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.152728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500db9d-94eb-4233-b18a-56bca8244f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.153058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500db9d-94eb-4233-b18a-56bca8244f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.153331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500db9d-94eb-4233-b18a-56bca8244f5e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.154305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500db9d-94eb-4233-b18a-56bca8244f5e admin admin] RBAC: Adding query filter params (role.id=2d69a9c6be9d41cdb97f566f3bc77f75, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=ee68d56c327f4e8eb32e019ea2326bfe) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:10.154626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500db9d-94eb-4233-b18a-56bca8244f5e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.156960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c500db9d-94eb-4233-b18a-56bca8244f5e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.169702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 444/886] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/role_assignments?user.id=ee68d56c327f4e8eb32e019ea2326bfe&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=2d69a9c6be9d41cdb97f566f3bc77f75 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:10.263429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901058-3e93-4d88-bf99-19e3cf7a3783 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.264466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901058-3e93-4d88-bf99-19e3cf7a3783 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.264466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7901058-3e93-4d88-bf99-19e3cf7a3783 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.266437 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 443/887] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:10.274411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49fdd9-1e79-4d52-abd6-cef907f4b9fb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.276392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49fdd9-1e79-4d52-abd6-cef907f4b9fb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.277115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49fdd9-1e79-4d52-abd6-cef907f4b9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.308033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6e49fdd9-1e79-4d52-abd6-cef907f4b9fb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:10.310810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6e49fdd9-1e79-4d52-abd6-cef907f4b9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:10.325359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 445/888] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:10 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:10.349878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7901058-3e93-4d88-bf99-19e3cf7a3783 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.363040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7901058-3e93-4d88-bf99-19e3cf7a3783 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.367628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.368480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.368752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.369016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.369795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.371458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.384048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 03:05:10.385666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 444/889] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:10.392897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49fdd9-1e79-4d52-abd6-cef907f4b9fb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.403361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49fdd9-1e79-4d52-abd6-cef907f4b9fb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.408583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.409634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.409917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.410188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.411315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:10.411617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.413342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.419443 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 446/890] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:10.426353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.438401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c4d0-6b3b-48af-a6a8-9ef2b6193f17 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.444524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.445229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.445596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.445905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.446728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:10.446982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.448692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.462247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 445/891] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:10.469669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.481095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c2db5-ef6b-4c80-8bf9-695ecdcdb6cf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.489705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3ccd-15da-436d-b2c8-0e402ead79c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.490834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3ccd-15da-436d-b2c8-0e402ead79c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.491331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3ccd-15da-436d-b2c8-0e402ead79c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.491815 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3ccd-15da-436d-b2c8-0e402ead79c3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.493387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3ccd-15da-436d-b2c8-0e402ead79c3 admin admin] RBAC: Adding query filter params (interface=public, service_id=73de2763eb6a4b18b91d53cf6aaeaf3f, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:10.497863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3ccd-15da-436d-b2c8-0e402ead79c3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.499894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3ccd-15da-436d-b2c8-0e402ead79c3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.506652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 447/892] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/endpoints?service_id=73de2763eb6a4b18b91d53cf6aaeaf3f&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:10.514538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:10.533154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8d86f-aab9-424c-8907-3f7872f548ec admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:10.541088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9708f996-26a3-4893-95d9-0590888d3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:10.542251 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f996-26a3-4893-95d9-0590888d3322 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:10.542751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f996-26a3-4893-95d9-0590888d3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:10.543246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9708f996-26a3-4893-95d9-0590888d3322 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:10.544555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708f996-26a3-4893-95d9-0590888d3322 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:10.548551 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9708f996-26a3-4893-95d9-0590888d3322 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:10.562936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 446/893] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:05:10 2021] GET /identity/v3/services => generated 1497 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:05:12.713613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f97d-1887-4e67-92ec-c12f3796fe9d None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:12.714143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f97d-1887-4e67-92ec-c12f3796fe9d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:12.714143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f529f97d-1887-4e67-92ec-c12f3796fe9d None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:12.716224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 448/894] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:12.723722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c84c01-e822-43a2-8443-87170d89b56e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:12.724565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c84c01-e822-43a2-8443-87170d89b56e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:12.725009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c84c01-e822-43a2-8443-87170d89b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:12.744375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b2c84c01-e822-43a2-8443-87170d89b56e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:12.745895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b2c84c01-e822-43a2-8443-87170d89b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:12.761551 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 447/895] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:12 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:12.780992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f97d-1887-4e67-92ec-c12f3796fe9d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:12.795118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f529f97d-1887-4e67-92ec-c12f3796fe9d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:12.800775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:12.801929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:12.802354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:12.802795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:12.803626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:12.805531 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:12.818688 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 16 03:05:12.825561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 449/896] 10.222.0.31 () {56 vars in 1126 bytes} [Tue Nov 16 03:05:12 2021] GET /identity/v3/services/image => generated 86 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:12.829120 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c84c01-e822-43a2-8443-87170d89b56e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:12.838854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c84c01-e822-43a2-8443-87170d89b56e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:12.844190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04546efa-a851-47ae-bc21-0a1ace776381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:12.844969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546efa-a851-47ae-bc21-0a1ace776381 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:12.845249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546efa-a851-47ae-bc21-0a1ace776381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:12.845556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546efa-a851-47ae-bc21-0a1ace776381 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:12.846341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546efa-a851-47ae-bc21-0a1ace776381 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:12.846645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546efa-a851-47ae-bc21-0a1ace776381 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:12.848314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546efa-a851-47ae-bc21-0a1ace776381 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:12.860066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 448/897] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:12 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:12.861618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:12.871778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ab2d-33a5-4541-b14e-488db9a86895 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:12.877601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4799ba1-49ca-4294-9e79-95d2bb88ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:12.878319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4799ba1-49ca-4294-9e79-95d2bb88ba58 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:12.878594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4799ba1-49ca-4294-9e79-95d2bb88ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:12.878866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4799ba1-49ca-4294-9e79-95d2bb88ba58 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:12.879599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4799ba1-49ca-4294-9e79-95d2bb88ba58 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:12.879899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4799ba1-49ca-4294-9e79-95d2bb88ba58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:12.881734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4799ba1-49ca-4294-9e79-95d2bb88ba58 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:12.893621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 450/898] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:12 2021] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:12.954182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33597f3d-6d84-4cbb-8a80-1434dc9a3d91 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:12.954620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33597f3d-6d84-4cbb-8a80-1434dc9a3d91 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:12.954854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33597f3d-6d84-4cbb-8a80-1434dc9a3d91 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:12.957008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 449/899] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:12.963437 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57241497-0c66-43d8-a829-8b9769bf18f6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:12.963936 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57241497-0c66-43d8-a829-8b9769bf18f6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:12.964183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57241497-0c66-43d8-a829-8b9769bf18f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:12.988027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-57241497-0c66-43d8-a829-8b9769bf18f6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:12.989293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-57241497-0c66-43d8-a829-8b9769bf18f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:12.997680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 451/900] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:12 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:13.022125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33597f3d-6d84-4cbb-8a80-1434dc9a3d91 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.036374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33597f3d-6d84-4cbb-8a80-1434dc9a3d91 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.041003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.041881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.042149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.042431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.043132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.045891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.059140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 03:05:13.061623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 450/901] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services/object-store => generated 93 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:13.067539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57241497-0c66-43d8-a829-8b9769bf18f6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.077961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57241497-0c66-43d8-a829-8b9769bf18f6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.082845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.083540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.083817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.084075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.084806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:13.085102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.086863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.093318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 452/902] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:13.100096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.111131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dcc13-0535-4011-8743-8c3b9d986a7c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.116053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75648abc-a2cd-42a1-9c31-9600b7e16c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.116721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648abc-a2cd-42a1-9c31-9600b7e16c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.116999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648abc-a2cd-42a1-9c31-9600b7e16c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.117252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75648abc-a2cd-42a1-9c31-9600b7e16c2a admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.118082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648abc-a2cd-42a1-9c31-9600b7e16c2a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:13.118385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648abc-a2cd-42a1-9c31-9600b7e16c2a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.120110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75648abc-a2cd-42a1-9c31-9600b7e16c2a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.126742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 451/903] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:13.133474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.148704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847a835-53ad-4666-9875-85e5e7fd5b49 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.153905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a9108-dba5-4538-9987-43dbcaba52fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.155311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9108-dba5-4538-9987-43dbcaba52fa admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.155611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9108-dba5-4538-9987-43dbcaba52fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.155889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9108-dba5-4538-9987-43dbcaba52fa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.156710 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a9108-dba5-4538-9987-43dbcaba52fa admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.159294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a9108-dba5-4538-9987-43dbcaba52fa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.188984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 453/904] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:05:13 2021] POST /identity/v3/endpoints => generated 349 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:13.441325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68bf1-16c7-4a1d-8ad1-382af2e5a9b8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.441836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68bf1-16c7-4a1d-8ad1-382af2e5a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.442328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68bf1-16c7-4a1d-8ad1-382af2e5a9b8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.445841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 452/905] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:13 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:05:13.452643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b903b0e-f332-473a-9841-62493902adae None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.453256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b903b0e-f332-473a-9841-62493902adae None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.453793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b903b0e-f332-473a-9841-62493902adae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.478342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7b903b0e-f332-473a-9841-62493902adae None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:13.479687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7b903b0e-f332-473a-9841-62493902adae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:13.504464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 454/906] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:13 2021] POST /identity/v3/auth/tokens => generated 2141 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:13.528119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d68bf1-16c7-4a1d-8ad1-382af2e5a9b8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.546131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d68bf1-16c7-4a1d-8ad1-382af2e5a9b8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.551843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.553158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.553697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.554198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.555281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.557420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.575062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 16 03:05:13.578165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 453/907] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services/compute => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:13.590069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b903b0e-f332-473a-9841-62493902adae None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.607228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b903b0e-f332-473a-9841-62493902adae None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.616104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e957d32-0d4d-4546-af21-a5a7cc4edecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.617884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e957d32-0d4d-4546-af21-a5a7cc4edecd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.618689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e957d32-0d4d-4546-af21-a5a7cc4edecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.619284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e957d32-0d4d-4546-af21-a5a7cc4edecd admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.620402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e957d32-0d4d-4546-af21-a5a7cc4edecd admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:13.620939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e957d32-0d4d-4546-af21-a5a7cc4edecd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.623057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e957d32-0d4d-4546-af21-a5a7cc4edecd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.630450 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 455/908] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:13.638542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.652910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df730c-b6ab-4e8c-b660-59765ec4ebe7 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.653725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df730c-b6ab-4e8c-b660-59765ec4ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.654322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df730c-b6ab-4e8c-b660-59765ec4ebe7 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.656832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40117ceb-0805-490a-96a2-4ca92e33ea00 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.657126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 456/909] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:13.665668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f401c-f981-4071-9dce-c500551e72fd None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.665934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.666522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f401c-f981-4071-9dce-c500551e72fd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.666902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.667217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f401c-f981-4071-9dce-c500551e72fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.667435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.667873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.669268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:13.669921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.673088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.693589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 454/910] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:13.695892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fb2f401c-f981-4071-9dce-c500551e72fd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:13.698334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fb2f401c-f981-4071-9dce-c500551e72fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:13.714337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 457/911] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:13 2021] POST /identity/v3/auth/tokens => generated 2141 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:13.742518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.762442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837790ec-cd06-478c-bffe-2c44b66f6561 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.771795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.773542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.774204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.774781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.776371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.780304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.804345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 16 03:05:13.808437 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 455/912] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:13.820745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f401c-f981-4071-9dce-c500551e72fd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.840373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f401c-f981-4071-9dce-c500551e72fd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.849218 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.850530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.851029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.851573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.853083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:13.853690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.857086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.870312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 458/913] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:13.881829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.901025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4995a-faf9-4d2b-b1bd-c1dc3430f289 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.909343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c283d3-333c-453c-bfd3-cc8ae14d09fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.911023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c283d3-333c-453c-bfd3-cc8ae14d09fa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.911515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c283d3-333c-453c-bfd3-cc8ae14d09fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.911996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c283d3-333c-453c-bfd3-cc8ae14d09fa admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.913457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c283d3-333c-453c-bfd3-cc8ae14d09fa admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:13.914017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c283d3-333c-453c-bfd3-cc8ae14d09fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.917284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c283d3-333c-453c-bfd3-cc8ae14d09fa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:13.927839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 456/914] 10.222.0.31 () {56 vars in 1135 bytes} [Tue Nov 16 03:05:13 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:13.938729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:13.960111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cea1f-53cb-4a49-acc1-5bc5e3ab4890 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:13.968199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca51e55-dac6-49fe-b8cc-2bc2e4ee49bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:13.969550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51e55-dac6-49fe-b8cc-2bc2e4ee49bc admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:13.970000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51e55-dac6-49fe-b8cc-2bc2e4ee49bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:13.970498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca51e55-dac6-49fe-b8cc-2bc2e4ee49bc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:13.972097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca51e55-dac6-49fe-b8cc-2bc2e4ee49bc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:13.975622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca51e55-dac6-49fe-b8cc-2bc2e4ee49bc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:14.015093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 459/915] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:05:13 2021] POST /identity/v3/endpoints => generated 346 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:05:15.738298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4930ab-4861-4e75-a5b7-70514a595ccd None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:15.739095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4930ab-4861-4e75-a5b7-70514a595ccd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:15.739095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4930ab-4861-4e75-a5b7-70514a595ccd None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:15.740916 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 457/916] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:15.747638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6f56-f0ba-4589-be3d-5a31166e1678 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:15.748433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6f56-f0ba-4589-be3d-5a31166e1678 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:15.748828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f6f56-f0ba-4589-be3d-5a31166e1678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:15.768518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6d9f6f56-f0ba-4589-be3d-5a31166e1678 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:15.769764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6d9f6f56-f0ba-4589-be3d-5a31166e1678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:15.793550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 460/917] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:15 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:15.817133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4930ab-4861-4e75-a5b7-70514a595ccd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:15.833558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4930ab-4861-4e75-a5b7-70514a595ccd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:15.841274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:15.843097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:15.843618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:15.844085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:15.844957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:15.846829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:15.860351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 03:05:15.872398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 458/918] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:15 2021] GET /identity/v3/services/object-store => generated 93 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:15.875216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6f56-f0ba-4589-be3d-5a31166e1678 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:15.887095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f6f56-f0ba-4589-be3d-5a31166e1678 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:15.893035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:15.894071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:15.894584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:15.895051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:15.896023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:15.896563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:15.898403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:15.909610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 461/919] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:15 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:15.912293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:15.923479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2320b0-789a-41ab-b37c-58924f91aa5e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:15.928625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:15.929587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:15.930091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:15.930558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:15.931480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:15.931978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:15.933829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:15.945581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 459/920] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:15 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:15.948583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:15.960303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38394441-a74e-47ac-bfbb-299b83573f31 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:15.965868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2a12-5516-4471-a6eb-2ab93e02c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:15.967531 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2a12-5516-4471-a6eb-2ab93e02c0cc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:15.968160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2a12-5516-4471-a6eb-2ab93e02c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:15.968648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2a12-5516-4471-a6eb-2ab93e02c0cc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:15.969852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2a12-5516-4471-a6eb-2ab93e02c0cc admin admin] RBAC: Adding query filter params (interface=admin, service_id=73de2763eb6a4b18b91d53cf6aaeaf3f, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:15.970581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2a12-5516-4471-a6eb-2ab93e02c0cc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:15.972703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2a12-5516-4471-a6eb-2ab93e02c0cc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:15.985697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 462/921] 10.222.0.31 () {56 vars in 1270 bytes} [Tue Nov 16 03:05:15 2021] GET /identity/v3/endpoints?service_id=73de2763eb6a4b18b91d53cf6aaeaf3f&interface=admin®ion_id=RegionOne => generated 193 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:15.991172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:16.002550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722f07a-b13b-40d3-a6c4-dc60ad170556 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:16.008137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b87fa-c3fe-478f-8949-fd4bc0e0de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:16.009033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b87fa-c3fe-478f-8949-fd4bc0e0de03 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:16.009541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b87fa-c3fe-478f-8949-fd4bc0e0de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:16.010001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b87fa-c3fe-478f-8949-fd4bc0e0de03 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:16.010881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b87fa-c3fe-478f-8949-fd4bc0e0de03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:16.012663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b87fa-c3fe-478f-8949-fd4bc0e0de03 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:16.025599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 460/922] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:05:15 2021] GET /identity/v3/services => generated 1497 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:05:16.424619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526ba6a-b904-4d07-a53e-3fe9366cb1aa None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:16.425018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526ba6a-b904-4d07-a53e-3fe9366cb1aa None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:16.425534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526ba6a-b904-4d07-a53e-3fe9366cb1aa None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:16.429467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 463/923] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:16 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:16.440883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37df0-89bd-47a9-9c9a-8674b2f5689e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:16.441366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37df0-89bd-47a9-9c9a-8674b2f5689e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:16.441908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37df0-89bd-47a9-9c9a-8674b2f5689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:16.474140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-66b37df0-89bd-47a9-9c9a-8674b2f5689e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:16.476310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-66b37df0-89bd-47a9-9c9a-8674b2f5689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:16.490446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 461/924] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:16 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:16.531346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526ba6a-b904-4d07-a53e-3fe9366cb1aa None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:16.552676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526ba6a-b904-4d07-a53e-3fe9366cb1aa None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:16.560726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbadb2-15c7-4f5d-b1c3-0b90e22a84a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:16.561670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbadb2-15c7-4f5d-b1c3-0b90e22a84a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:16.562167 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbadb2-15c7-4f5d-b1c3-0b90e22a84a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:16.562659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbadb2-15c7-4f5d-b1c3-0b90e22a84a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:16.564045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbadb2-15c7-4f5d-b1c3-0b90e22a84a9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:16.567179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbadb2-15c7-4f5d-b1c3-0b90e22a84a9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:16.593254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 464/925] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:05:16 2021] POST /identity/v3/services => generated 242 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:05:16.599756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2b51-f056-4d84-a1e5-eb963279be3b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:16.600193 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2b51-f056-4d84-a1e5-eb963279be3b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:16.600621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa2b51-f056-4d84-a1e5-eb963279be3b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:16.604133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 462/926] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:16.614007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87711229-cf0e-4659-bda7-3d5b6c1f9a4a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:16.614434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87711229-cf0e-4659-bda7-3d5b6c1f9a4a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:16.614853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87711229-cf0e-4659-bda7-3d5b6c1f9a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:16.644159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-87711229-cf0e-4659-bda7-3d5b6c1f9a4a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:16.645983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-87711229-cf0e-4659-bda7-3d5b6c1f9a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:16.675637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 465/927] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:16 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:16.713212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2b51-f056-4d84-a1e5-eb963279be3b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:16.733180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa2b51-f056-4d84-a1e5-eb963279be3b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:16.740060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c76a2-9bcb-4a0d-8f76-9a8be4237431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:16.741332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c76a2-9bcb-4a0d-8f76-9a8be4237431 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:16.741854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c76a2-9bcb-4a0d-8f76-9a8be4237431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:16.742281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c76a2-9bcb-4a0d-8f76-9a8be4237431 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:16.743841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c76a2-9bcb-4a0d-8f76-9a8be4237431 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:16.746765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c76a2-9bcb-4a0d-8f76-9a8be4237431 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:16.773563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 463/928] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:05:16 2021] POST /identity/v3/services => generated 242 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:17.177780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581de39-fd17-4ac0-b25c-e8c491825ea6 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:17.178509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581de39-fd17-4ac0-b25c-e8c491825ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:17.178509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581de39-fd17-4ac0-b25c-e8c491825ea6 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:17.180141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 466/929] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:17.187922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9a3a8-19c0-4b07-8774-363757b88a8b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:17.188327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9a3a8-19c0-4b07-8774-363757b88a8b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:17.188479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9a3a8-19c0-4b07-8774-363757b88a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:17.209411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-aca9a3a8-19c0-4b07-8774-363757b88a8b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:17.210988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-aca9a3a8-19c0-4b07-8774-363757b88a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:17.231449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 464/930] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:17 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:17.260350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581de39-fd17-4ac0-b25c-e8c491825ea6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:17.274322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581de39-fd17-4ac0-b25c-e8c491825ea6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:17.279620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:17.280289 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:17.280573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:17.280948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:17.281754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:17.283700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:17.285195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.common [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 16 03:05:17.305632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.sql.core [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 16 03:05:17.305632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 16 03:05:17.305632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [parameters: {'id': '7458a2d0f8e044b78da4d0909af9076c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 16 03:05:17.305632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79351) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 16 03:05:17.314022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7458a2d0f8e044b78da4d0909af9076c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7458a2d0f8e044b78da4d0909af9076c. Nov 16 03:05:17.315878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 467/931] 10.222.0.31 () {60 vars in 1161 bytes} [Tue Nov 16 03:05:17 2021] POST /identity/v3/projects => generated 262 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:17.323665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9a3a8-19c0-4b07-8774-363757b88a8b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:17.339699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9a3a8-19c0-4b07-8774-363757b88a8b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:17.348174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87c7ea-08ea-4986-80b8-dfb13d204908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:17.349739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87c7ea-08ea-4986-80b8-dfb13d204908 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:17.350292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87c7ea-08ea-4986-80b8-dfb13d204908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:17.350771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87c7ea-08ea-4986-80b8-dfb13d204908 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:17.365085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87c7ea-08ea-4986-80b8-dfb13d204908 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:17.369308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87c7ea-08ea-4986-80b8-dfb13d204908 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:17.394863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-aa87c7ea-08ea-4986-80b8-dfb13d204908 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:17.397503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 465/932] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:17.404887 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:17.419435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee4b51-3749-4adc-aa77-783ccc842a1f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:17.425400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444e02c-8b7f-4463-8d8b-ed4c120f2a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:17.426469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e02c-8b7f-4463-8d8b-ed4c120f2a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:17.426945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e02c-8b7f-4463-8d8b-ed4c120f2a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:17.427406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444e02c-8b7f-4463-8d8b-ed4c120f2a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:17.428474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444e02c-8b7f-4463-8d8b-ed4c120f2a1c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:17.428998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444e02c-8b7f-4463-8d8b-ed4c120f2a1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:17.431636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444e02c-8b7f-4463-8d8b-ed4c120f2a1c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:17.456319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 468/933] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:05:17 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:18.733236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69727fe-95ba-4669-90e5-f6960e1bf30e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:18.734340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69727fe-95ba-4669-90e5-f6960e1bf30e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:18.734850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69727fe-95ba-4669-90e5-f6960e1bf30e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:18.737303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 466/934] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:18.744856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20ca7-0b7a-4dc8-a120-b9774fc79f99 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:18.745882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20ca7-0b7a-4dc8-a120-b9774fc79f99 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:18.746371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e20ca7-0b7a-4dc8-a120-b9774fc79f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:18.767607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b7e20ca7-0b7a-4dc8-a120-b9774fc79f99 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:18.769597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b7e20ca7-0b7a-4dc8-a120-b9774fc79f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:18.778604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 469/935] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:18 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:18.803836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69727fe-95ba-4669-90e5-f6960e1bf30e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:18.818835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69727fe-95ba-4669-90e5-f6960e1bf30e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:18.824481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:18.825948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:18.826466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:18.826932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:18.833485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:18.833485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:18.842821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 16 03:05:18.844427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 467/936] 10.222.0.31 () {56 vars in 1147 bytes} [Tue Nov 16 03:05:18 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:18.851765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e20ca7-0b7a-4dc8-a120-b9774fc79f99 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:18.861869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e20ca7-0b7a-4dc8-a120-b9774fc79f99 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:18.866774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:18.867470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:18.867747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:18.868017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:18.868790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:18.869083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:18.870847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:18.877869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 470/937] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:18 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:18.884584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:18.895459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf074805-f13e-49d0-a350-ac9cea951e03 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:18.900372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d319530-c81b-4ff9-acfa-5215c0af6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:18.901056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d319530-c81b-4ff9-acfa-5215c0af6a81 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:18.901333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d319530-c81b-4ff9-acfa-5215c0af6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:18.901649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d319530-c81b-4ff9-acfa-5215c0af6a81 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:18.902394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d319530-c81b-4ff9-acfa-5215c0af6a81 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:18.902696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d319530-c81b-4ff9-acfa-5215c0af6a81 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:18.904525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d319530-c81b-4ff9-acfa-5215c0af6a81 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:18.911400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 468/938] 10.222.0.31 () {56 vars in 1143 bytes} [Tue Nov 16 03:05:18 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:18.918451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:18.929488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd656dfe-d252-42e7-b526-86a56510b4f9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:18.934618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe0b37-f359-477f-bb7e-2fa325ee9a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:18.935416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0b37-f359-477f-bb7e-2fa325ee9a0a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:18.935788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0b37-f359-477f-bb7e-2fa325ee9a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:18.936481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe0b37-f359-477f-bb7e-2fa325ee9a0a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:18.936740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe0b37-f359-477f-bb7e-2fa325ee9a0a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:18.938408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe0b37-f359-477f-bb7e-2fa325ee9a0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:18.964997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 471/939] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:05:18 2021] POST /identity/v3/endpoints => generated 325 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:05:19.217652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051067fc-bfde-453f-96c0-9f25318abe27 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.217652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051067fc-bfde-453f-96c0-9f25318abe27 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.217652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051067fc-bfde-453f-96c0-9f25318abe27 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.219853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 469/940] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:19.228212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24c4c-d608-455b-8460-f7b0dfb3cd2f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.228640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24c4c-d608-455b-8460-f7b0dfb3cd2f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.229006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24c4c-d608-455b-8460-f7b0dfb3cd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.250209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f2b24c4c-d608-455b-8460-f7b0dfb3cd2f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:19.251462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f2b24c4c-d608-455b-8460-f7b0dfb3cd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:19.271131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 472/941] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:19 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:19.296160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051067fc-bfde-453f-96c0-9f25318abe27 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.309396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051067fc-bfde-453f-96c0-9f25318abe27 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.314150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.314957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.315232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.315502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] PATH_INFO: `/v3/services/image` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.316176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.317824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.329721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 16 03:05:19.331299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 470/942] 10.222.0.31 () {56 vars in 1126 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:19.338222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24c4c-d608-455b-8460-f7b0dfb3cd2f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.349325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24c4c-d608-455b-8460-f7b0dfb3cd2f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.354309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.354993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.355267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.355540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.356291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:19.356584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.358580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.364817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 473/943] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:19.371542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.383097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0593-4a66-47d4-8222-5f6bec79c5fe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.388414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.389510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.389696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.389906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.390667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:19.390967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.392841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.401098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 471/944] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services?type=image => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:19.410157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.424606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4088e7-a6e7-4bcc-baaf-c5ef33bc3c89 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.431036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b9a9c-d218-4a1c-9408-1af131495de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.431810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b9a9c-d218-4a1c-9408-1af131495de7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.432298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b9a9c-d218-4a1c-9408-1af131495de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.432722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b9a9c-d218-4a1c-9408-1af131495de7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.434206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b9a9c-d218-4a1c-9408-1af131495de7 admin admin] RBAC: Adding query filter params (interface=public, service_id=68279aec446240e0918ec86ed3324b61, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:19.434789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b9a9c-d218-4a1c-9408-1af131495de7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.437591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b9a9c-d218-4a1c-9408-1af131495de7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.445554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 474/945] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/endpoints?service_id=68279aec446240e0918ec86ed3324b61&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:19.454435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.468744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f3278-0895-4553-819d-5a24b20d7927 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.475198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e503d75-9398-4eed-8c13-422628f2fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.476162 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e503d75-9398-4eed-8c13-422628f2fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.476441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e503d75-9398-4eed-8c13-422628f2fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.477011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e503d75-9398-4eed-8c13-422628f2fbf0 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.478190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e503d75-9398-4eed-8c13-422628f2fbf0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.480328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e503d75-9398-4eed-8c13-422628f2fbf0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.498041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 472/946] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services => generated 1957 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:05:19.587154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8fbfe-8014-4b7b-88af-cb357d90c4f4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.587514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8fbfe-8014-4b7b-88af-cb357d90c4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.587721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8fbfe-8014-4b7b-88af-cb357d90c4f4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.590077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 475/947] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:19.597008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c493e0e-ea12-4b7f-a110-2a1107f31211 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.597668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c493e0e-ea12-4b7f-a110-2a1107f31211 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.598186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c493e0e-ea12-4b7f-a110-2a1107f31211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.618568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8c493e0e-ea12-4b7f-a110-2a1107f31211 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:19.620258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8c493e0e-ea12-4b7f-a110-2a1107f31211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:19.629945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 473/948] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:19 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:19.654521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8fbfe-8014-4b7b-88af-cb357d90c4f4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.668023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b8fbfe-8014-4b7b-88af-cb357d90c4f4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.673146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.674395 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.674890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.675351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.676220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.678160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.690599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 16 03:05:19.692575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 476/949] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:19.699916 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c493e0e-ea12-4b7f-a110-2a1107f31211 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.711277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c493e0e-ea12-4b7f-a110-2a1107f31211 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.716642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.717787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.718273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.718742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.719888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:19.720407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.723034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.730789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 474/950] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:19.740719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.751899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7933ef-6f0d-4167-845d-6c8bf84d030a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.757606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.758691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.759165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.759670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.760591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:19.761117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.763063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.769598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 477/951] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:19.776875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.788978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d757e-1578-4033-82c5-425ebd4ab66b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.794508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9beff-1ea8-46fd-bbe8-4202d3fdcf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.795732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9beff-1ea8-46fd-bbe8-4202d3fdcf97 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.796215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9beff-1ea8-46fd-bbe8-4202d3fdcf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.796712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9beff-1ea8-46fd-bbe8-4202d3fdcf97 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.797845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9beff-1ea8-46fd-bbe8-4202d3fdcf97 admin admin] RBAC: Adding query filter params (interface=public, service_id=476a5f770fbe49aa820d22fd4c3e6e15, region_id=RegionOne) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:19.798375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9beff-1ea8-46fd-bbe8-4202d3fdcf97 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.800419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9beff-1ea8-46fd-bbe8-4202d3fdcf97 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.815519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 475/952] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/endpoints?service_id=476a5f770fbe49aa820d22fd4c3e6e15&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:19.833901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:19.848651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c818b6f-dbb1-469d-bec4-bd8f37c27b94 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:19.855447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451876-21ea-49e2-a997-abfc08275c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:19.856123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451876-21ea-49e2-a997-abfc08275c5c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:19.856399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451876-21ea-49e2-a997-abfc08275c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:19.856666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451876-21ea-49e2-a997-abfc08275c5c admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:19.857491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451876-21ea-49e2-a997-abfc08275c5c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:19.859215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451876-21ea-49e2-a997-abfc08275c5c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:19.868119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 478/953] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:05:19 2021] GET /identity/v3/services => generated 1957 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:05:20.162958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540019e4-bee7-4e04-b045-cd5b200199f7 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:20.163216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540019e4-bee7-4e04-b045-cd5b200199f7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:20.163547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540019e4-bee7-4e04-b045-cd5b200199f7 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:20.165534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 476/954] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:20.173157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50ac8-4189-4499-aa6e-c6cecf8b5f6a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:20.173572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50ac8-4189-4499-aa6e-c6cecf8b5f6a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:20.173724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db50ac8-4189-4499-aa6e-c6cecf8b5f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:20.192637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0db50ac8-4189-4499-aa6e-c6cecf8b5f6a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:20.193882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0db50ac8-4189-4499-aa6e-c6cecf8b5f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:20.205576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 479/955] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:20 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:20.229849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540019e4-bee7-4e04-b045-cd5b200199f7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:20.243692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540019e4-bee7-4e04-b045-cd5b200199f7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:20.249342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:20.250143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:20.250426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:20.250703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:20.251504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:20.253459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:20.254853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.common [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 16 03:05:20.269299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.sql.core [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 16 03:05:20.269299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 16 03:05:20.269299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [parameters: {'user_id': '5207167e3d014227ac5ad3d4266af88c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 16 03:05:20.269299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79350) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 16 03:05:20.286203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 16 03:05:20.292055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 477/956] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:05:20 2021] POST /identity/v3/users => generated 160 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:20.296225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db50ac8-4189-4499-aa6e-c6cecf8b5f6a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:20.309062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db50ac8-4189-4499-aa6e-c6cecf8b5f6a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:20.314750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061e821-63f8-48da-8fa9-3469c86e9fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:20.315565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e821-63f8-48da-8fa9-3469c86e9fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:20.315840 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e821-63f8-48da-8fa9-3469c86e9fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:20.316109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061e821-63f8-48da-8fa9-3469c86e9fc9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:20.325088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061e821-63f8-48da-8fa9-3469c86e9fc9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:20.327811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061e821-63f8-48da-8fa9-3469c86e9fc9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:20.343225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-1061e821-63f8-48da-8fa9-3469c86e9fc9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 16 03:05:20.344768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 480/957] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:20 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:20.351649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:20.367338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a57b-a3d8-4b4d-9639-eacbd6efd84c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:20.374886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de56e4-c76b-4fda-9328-c2ac538ce55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:20.376165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de56e4-c76b-4fda-9328-c2ac538ce55a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:20.376755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de56e4-c76b-4fda-9328-c2ac538ce55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:20.377363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de56e4-c76b-4fda-9328-c2ac538ce55a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:20.378973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de56e4-c76b-4fda-9328-c2ac538ce55a admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:20.379583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de56e4-c76b-4fda-9328-c2ac538ce55a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:20.382427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de56e4-c76b-4fda-9328-c2ac538ce55a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:20.453054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 478/958] 10.222.0.31 () {56 vars in 1122 bytes} [Tue Nov 16 03:05:20 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:21.416381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22f7ea-041f-403a-9f36-6038e2f1868c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:21.420733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22f7ea-041f-403a-9f36-6038e2f1868c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:21.420733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22f7ea-041f-403a-9f36-6038e2f1868c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:21.421006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 481/959] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:21.428239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ddd6-48b2-418b-ad44-7a688082ff07 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:21.428976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ddd6-48b2-418b-ad44-7a688082ff07 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:21.428976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61ddd6-48b2-418b-ad44-7a688082ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:21.449837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fe61ddd6-48b2-418b-ad44-7a688082ff07 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:21.451618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fe61ddd6-48b2-418b-ad44-7a688082ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:21.459521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 479/960] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:21 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:21.486310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22f7ea-041f-403a-9f36-6038e2f1868c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:21.501095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22f7ea-041f-403a-9f36-6038e2f1868c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:21.505784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a8f115-87af-4d9a-8b55-4799ae727963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:21.506584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f115-87af-4d9a-8b55-4799ae727963 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:21.506860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f115-87af-4d9a-8b55-4799ae727963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:21.507130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a8f115-87af-4d9a-8b55-4799ae727963 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:21.508341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8f115-87af-4d9a-8b55-4799ae727963 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:21.510082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a8f115-87af-4d9a-8b55-4799ae727963 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:21.511904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 482/961] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:21.519028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ddd6-48b2-418b-ad44-7a688082ff07 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:21.528416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61ddd6-48b2-418b-ad44-7a688082ff07 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:21.538289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bb287-f52c-489d-bc86-5295dbc7c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:21.538969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb287-f52c-489d-bc86-5295dbc7c891 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:21.539298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb287-f52c-489d-bc86-5295dbc7c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:21.539540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bb287-f52c-489d-bc86-5295dbc7c891 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:21.540215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb287-f52c-489d-bc86-5295dbc7c891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:21.542191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bb287-f52c-489d-bc86-5295dbc7c891 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:21.572320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 480/962] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:05:21 2021] POST /identity/v3/projects => generated 311 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:22.274134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed0d7-3652-4956-8ddc-2e28299dbfa7 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.274384 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed0d7-3652-4956-8ddc-2e28299dbfa7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.274665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ed0d7-3652-4956-8ddc-2e28299dbfa7 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.276656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 483/963] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:22.283603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90ed9-3ca2-4662-a43d-ce9a3ca6483c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.283958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90ed9-3ca2-4662-a43d-ce9a3ca6483c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.284302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f90ed9-3ca2-4662-a43d-ce9a3ca6483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.303101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-82f90ed9-3ca2-4662-a43d-ce9a3ca6483c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:22.304313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-82f90ed9-3ca2-4662-a43d-ce9a3ca6483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:22.365479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 481/964] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:22 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:22.389239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed0d7-3652-4956-8ddc-2e28299dbfa7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.402347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ed0d7-3652-4956-8ddc-2e28299dbfa7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.407673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.408470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.408784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.409044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.409704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.411699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.423921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 16 03:05:22.429516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 484/965] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:22 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:22.437691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90ed9-3ca2-4662-a43d-ce9a3ca6483c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.461121 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f90ed9-3ca2-4662-a43d-ce9a3ca6483c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.466205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.467236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.467574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.468023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.468845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:22.469154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.470959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.477540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 482/966] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:05:22 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:22.484355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.494515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba737177-cc35-416c-b4d6-a4bef4c93ac0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.499269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c5b86-cb9b-435c-91e7-7b3ce1967d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.499928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5b86-cb9b-435c-91e7-7b3ce1967d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.500199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5b86-cb9b-435c-91e7-7b3ce1967d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.500468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c5b86-cb9b-435c-91e7-7b3ce1967d9c admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.501195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5b86-cb9b-435c-91e7-7b3ce1967d9c admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:22.501520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5b86-cb9b-435c-91e7-7b3ce1967d9c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.503112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c5b86-cb9b-435c-91e7-7b3ce1967d9c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.508743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 485/967] 10.222.0.31 () {56 vars in 1133 bytes} [Tue Nov 16 03:05:22 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:22.515182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.530998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081fee0-a6db-4b7f-8174-021f071dc03d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.536184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659b015-e6e9-49ff-bed8-d6917666b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.536844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b015-e6e9-49ff-bed8-d6917666b3d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.537125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b015-e6e9-49ff-bed8-d6917666b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.537401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659b015-e6e9-49ff-bed8-d6917666b3d8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.538209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659b015-e6e9-49ff-bed8-d6917666b3d8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.539925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659b015-e6e9-49ff-bed8-d6917666b3d8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.563153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 483/968] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:05:22 2021] POST /identity/v3/endpoints => generated 334 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:05:22.619325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e693-f154-4aa3-bd42-2f24ecff892d None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.619700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e693-f154-4aa3-bd42-2f24ecff892d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.619931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e693-f154-4aa3-bd42-2f24ecff892d None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.621985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 486/969] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:22.629011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab652c-7c43-4b07-b3e8-d4fd4e0aa859 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.629363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab652c-7c43-4b07-b3e8-d4fd4e0aa859 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.629621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab652c-7c43-4b07-b3e8-d4fd4e0aa859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.649299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-38ab652c-7c43-4b07-b3e8-d4fd4e0aa859 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:22.650563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-38ab652c-7c43-4b07-b3e8-d4fd4e0aa859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:22.670059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 484/970] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:22 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:22.694083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e693-f154-4aa3-bd42-2f24ecff892d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.707317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e693-f154-4aa3-bd42-2f24ecff892d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.711996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.712831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.713113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.713392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.714113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.715774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.727855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 16 03:05:22.729367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 487/971] 10.222.0.31 () {56 vars in 1126 bytes} [Tue Nov 16 03:05:22 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:22.736805 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab652c-7c43-4b07-b3e8-d4fd4e0aa859 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.746667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab652c-7c43-4b07-b3e8-d4fd4e0aa859 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.751804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.752520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.752806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.753082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.753874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:22.754209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.755944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.762213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 485/972] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:22 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:22.769470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.780884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405231f-6f4b-4b26-b4ce-45ea89ed8675 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.786259 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449668-8328-44df-a705-d938c0fd750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.786871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449668-8328-44df-a705-d938c0fd750c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.787157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449668-8328-44df-a705-d938c0fd750c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.787420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449668-8328-44df-a705-d938c0fd750c admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.788191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449668-8328-44df-a705-d938c0fd750c admin admin] RBAC: Adding query filter params (type=image) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:22.788495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449668-8328-44df-a705-d938c0fd750c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.790262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449668-8328-44df-a705-d938c0fd750c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.796535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 488/973] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:22 2021] GET /identity/v3/services?type=image => generated 350 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:22.803825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:22.814630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41337d-2682-447a-9d3d-04942abf4e76 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:22.819803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43a444-8da5-433f-ae49-5cb5865dbd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:22.820409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a444-8da5-433f-ae49-5cb5865dbd0f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:22.820688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a444-8da5-433f-ae49-5cb5865dbd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:22.820955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a444-8da5-433f-ae49-5cb5865dbd0f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:22.822742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43a444-8da5-433f-ae49-5cb5865dbd0f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:22.824510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43a444-8da5-433f-ae49-5cb5865dbd0f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:22.847366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 486/974] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:05:22 2021] POST /identity/v3/endpoints => generated 327 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:23.990863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ff3a-bbf8-4280-a287-c51d143d6f80 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:23.991429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ff3a-bbf8-4280-a287-c51d143d6f80 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:23.991429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ff3a-bbf8-4280-a287-c51d143d6f80 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:23.993312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 489/975] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:24.001133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98bb9-a758-4212-9bfd-282401b2036e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:24.001792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98bb9-a758-4212-9bfd-282401b2036e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:24.001792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d98bb9-a758-4212-9bfd-282401b2036e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:24.023456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b1d98bb9-a758-4212-9bfd-282401b2036e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:24.024695 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b1d98bb9-a758-4212-9bfd-282401b2036e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:24.045469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 487/976] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:23 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:24.070640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68ff3a-bbf8-4280-a287-c51d143d6f80 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:24.087751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68ff3a-bbf8-4280-a287-c51d143d6f80 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:24.092945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a73171-c727-4f7b-9cbf-11dd33470fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:24.093792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73171-c727-4f7b-9cbf-11dd33470fbd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:24.094071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73171-c727-4f7b-9cbf-11dd33470fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:24.094345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73171-c727-4f7b-9cbf-11dd33470fbd admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:24.095575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73171-c727-4f7b-9cbf-11dd33470fbd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:24.097272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73171-c727-4f7b-9cbf-11dd33470fbd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:24.099533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 490/977] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:24.106207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98bb9-a758-4212-9bfd-282401b2036e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:24.115463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d98bb9-a758-4212-9bfd-282401b2036e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:24.120127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954df5e7-97dd-42c9-91b3-380be05b949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:24.120886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954df5e7-97dd-42c9-91b3-380be05b949f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:24.121230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954df5e7-97dd-42c9-91b3-380be05b949f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:24.121598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954df5e7-97dd-42c9-91b3-380be05b949f admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:24.122413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954df5e7-97dd-42c9-91b3-380be05b949f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:24.124551 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954df5e7-97dd-42c9-91b3-380be05b949f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:24.146402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 488/978] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:05:24 2021] POST /identity/v3/users => generated 285 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:25.053713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c738b2-87c1-4fce-b9a5-ab5a0e6b500a None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.054375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c738b2-87c1-4fce-b9a5-ab5a0e6b500a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.054375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c738b2-87c1-4fce-b9a5-ab5a0e6b500a None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.056358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 491/979] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:25.063077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023e00-0801-4c02-9303-9cb2aaf27f58 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.063891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023e00-0801-4c02-9303-9cb2aaf27f58 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.063891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8023e00-0801-4c02-9303-9cb2aaf27f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.083189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f8023e00-0801-4c02-9303-9cb2aaf27f58 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:25.084323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f8023e00-0801-4c02-9303-9cb2aaf27f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:25.092779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 489/980] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:25.120697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c738b2-87c1-4fce-b9a5-ab5a0e6b500a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.144766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c738b2-87c1-4fce-b9a5-ab5a0e6b500a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.152359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c24963-423a-41d5-80c1-ed0896541df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.153600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24963-423a-41d5-80c1-ed0896541df2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.155103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24963-423a-41d5-80c1-ed0896541df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.155603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c24963-423a-41d5-80c1-ed0896541df2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.173481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c24963-423a-41d5-80c1-ed0896541df2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:25.181665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e1c24963-423a-41d5-80c1-ed0896541df2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 03:05:25.183135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 492/981] 10.222.0.31 () {56 vars in 1141 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:25.193858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8023e00-0801-4c02-9303-9cb2aaf27f58 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.206315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8023e00-0801-4c02-9303-9cb2aaf27f58 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.210739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1128c1-47fa-4cd2-86c9-103b37697f61 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.211023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1128c1-47fa-4cd2-86c9-103b37697f61 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.211299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1128c1-47fa-4cd2-86c9-103b37697f61 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.213258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 493/982] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:05:25.219234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.219744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718e0ab-5934-4931-8bbc-43ef3a1bfbe7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.219999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.220181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718e0ab-5934-4931-8bbc-43ef3a1bfbe7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.220334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718e0ab-5934-4931-8bbc-43ef3a1bfbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.224973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.225361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.226510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:25.226815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.228472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.239593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0718e0ab-5934-4931-8bbc-43ef3a1bfbe7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:25.240817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0718e0ab-5934-4931-8bbc-43ef3a1bfbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:25.245986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 490/983] 10.222.0.31 () {56 vars in 1136 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:25.249270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.251896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 494/984] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:25.259722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eb996-241b-4c61-8b83-d14c0c588308 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.264364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.265179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.265477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.265752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.278904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.281220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.287328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718e0ab-5934-4931-8bbc-43ef3a1bfbe7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.298634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718e0ab-5934-4931-8bbc-43ef3a1bfbe7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.299427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:25.300707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 491/985] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:25.304407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14602412-55c2-4704-9747-98936445612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.305162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14602412-55c2-4704-9747-98936445612e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.305529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14602412-55c2-4704-9747-98936445612e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.305864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14602412-55c2-4704-9747-98936445612e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.315143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14602412-55c2-4704-9747-98936445612e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.318615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.318818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14602412-55c2-4704-9747-98936445612e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.327732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5de222-213d-41d5-bb27-87bea3d7b211 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.327972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 495/986] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:25.332593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.333339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.333596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.333873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.334620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:25.334922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.335357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14602412-55c2-4704-9747-98936445612e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.336591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.346438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14602412-55c2-4704-9747-98936445612e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.351497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.353512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.353512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.353512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.355744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.357900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 492/987] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:25.358293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.359922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 496/988] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:25.360576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.375089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b48e26-65b7-43d1-8d12-19c64f441696 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.380507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.381377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.381710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.381993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.391989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.394297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.416614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:05:25.417964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 493/989] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:25.425347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.438697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd3ad2-d0c5-40af-8318-89448abec9c0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.444884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.445795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.446250 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.446606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.447660 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:25.448090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.450250 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.480061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 497/990] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:25.486918 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.497995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537eaf8c-af91-48b5-8fa3-2f6067029832 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.505000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.505771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.506115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.506352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.516056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.517967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.529844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 494/991] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:25.537491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.549077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a312a3-ab89-4ffd-940d-bfcc4ea27fa7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.554604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.555615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.556070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.556442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.570027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.572761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.598840 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:25.601295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 498/992] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:25.609051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.619521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973355d-7442-400e-8abb-35fa7d796c1f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.624540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.625612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.625985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.626355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.627222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:25.627617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.629322 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.648562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 495/993] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:25.655233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.666664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804b23e-9567-4fe6-922f-592223151cb2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.671633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.672651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.672761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.672982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.683068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.685123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.700492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:25.702571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 499/994] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:05:25.711110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.722086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9dcd8-813e-4c3e-8e1c-40c325e872d3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.727910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81767f-d759-440b-a54d-cc0af393133b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.728593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81767f-d759-440b-a54d-cc0af393133b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.728874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81767f-d759-440b-a54d-cc0af393133b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.729148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81767f-d759-440b-a54d-cc0af393133b admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.730004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81767f-d759-440b-a54d-cc0af393133b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:25.730317 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81767f-d759-440b-a54d-cc0af393133b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.732334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81767f-d759-440b-a54d-cc0af393133b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.748922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 496/995] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:25.758499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:25.770670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458c842-4284-4b60-abef-ac2a0b58416b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:25.776349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8704321c-c3ac-48b8-bc26-094e0085605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:25.777337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704321c-c3ac-48b8-bc26-094e0085605b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:25.777839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704321c-c3ac-48b8-bc26-094e0085605b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:25.778160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8704321c-c3ac-48b8-bc26-094e0085605b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:25.779131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704321c-c3ac-48b8-bc26-094e0085605b admin admin] RBAC: Adding query filter params (role.id=2d69a9c6be9d41cdb97f566f3bc77f75, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=cf258dbbf82147618bc5310aebd91a65) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:25.779545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704321c-c3ac-48b8-bc26-094e0085605b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:25.781707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8704321c-c3ac-48b8-bc26-094e0085605b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:25.788984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 500/996] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:25 2021] GET /identity/v3/role_assignments?user.id=cf258dbbf82147618bc5310aebd91a65&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=2d69a9c6be9d41cdb97f566f3bc77f75 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:26.595385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabf84-7350-4f56-93d1-400c371ea66a None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.596014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabf84-7350-4f56-93d1-400c371ea66a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.596014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aabf84-7350-4f56-93d1-400c371ea66a None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.597804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 497/997] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:26.604613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93dfe2-901a-482b-aeb9-7155a778ad16 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.605127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93dfe2-901a-482b-aeb9-7155a778ad16 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.605127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93dfe2-901a-482b-aeb9-7155a778ad16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.625414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bb93dfe2-901a-482b-aeb9-7155a778ad16 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:26.626639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bb93dfe2-901a-482b-aeb9-7155a778ad16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:26.636018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 501/998] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:26.661240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabf84-7350-4f56-93d1-400c371ea66a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:26.675631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aabf84-7350-4f56-93d1-400c371ea66a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:26.680647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:26.681471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.681763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.682041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.692858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:26.699685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:05:26.700969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 498/999] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:26.708156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93dfe2-901a-482b-aeb9-7155a778ad16 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:26.717844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93dfe2-901a-482b-aeb9-7155a778ad16 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:26.723103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:26.723762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.724036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.724297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.725061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:26.725359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:26.727010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:26.736452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 502/1000] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:26.743348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:26.754375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f79c7-d351-455d-b4a7-cd2412b433f8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:26.759436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:26.760293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.760577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.760836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] PATH_INFO: `/v3/users/6968a0a3ff794e22946a23b0f7241c3b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.774828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] RBAC: Authorizing `identity:get_user(user_id=6968a0a3ff794e22946a23b0f7241c3b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:26.777006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:26.779163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 499/1001] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:26 2021] GET /identity/v3/users/6968a0a3ff794e22946a23b0f7241c3b => generated 285 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:26.786039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:26.796556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d0620-391e-4e1e-8aa9-b3120a2f99b4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:26.802584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:26.803239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.803511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.803765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.812846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:26.814654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:26.824344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 503/1002] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:26.831114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:26.841134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719d6ff-bbaa-4c02-a6da-481065a4f905 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:26.846662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230c3840-29fe-47e9-a3a2-0ad3f731c73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:26.847450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c3840-29fe-47e9-a3a2-0ad3f731c73a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.847733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c3840-29fe-47e9-a3a2-0ad3f731c73a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.848006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c3840-29fe-47e9-a3a2-0ad3f731c73a admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.849212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c3840-29fe-47e9-a3a2-0ad3f731c73a admin admin] RBAC: Authorizing `identity:get_project(project_id=a7cbb7c9a7c044468e353ee1840b9679)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:26.851323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230c3840-29fe-47e9-a3a2-0ad3f731c73a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:26.852996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 500/1003] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:26 2021] GET /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:26.859948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:26.869528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d56d7-58a4-42f0-8ce1-828755032660 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:26.875169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a68a74-a30f-4283-931e-9ac85f578b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:26.875828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68a74-a30f-4283-931e-9ac85f578b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:26.876106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68a74-a30f-4283-931e-9ac85f578b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:26.876382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a68a74-a30f-4283-931e-9ac85f578b51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:26.877311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a68a74-a30f-4283-931e-9ac85f578b51 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=a7cbb7c9a7c044468e353ee1840b9679, user.id=6968a0a3ff794e22946a23b0f7241c3b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:26.877647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a68a74-a30f-4283-931e-9ac85f578b51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:26.879520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a68a74-a30f-4283-931e-9ac85f578b51 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:26.885900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 504/1004] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:26 2021] GET /identity/v3/role_assignments?user.id=6968a0a3ff794e22946a23b0f7241c3b&scope.project.id=a7cbb7c9a7c044468e353ee1840b9679&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:28.086705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206a2f-358a-425e-a63f-939f004aa0e3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.087248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206a2f-358a-425e-a63f-939f004aa0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.087426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12206a2f-358a-425e-a63f-939f004aa0e3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.089307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 501/1005] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:28.096680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12244fb-eed7-4d6e-ba0d-7e33e37869e2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.097243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12244fb-eed7-4d6e-ba0d-7e33e37869e2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.097243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12244fb-eed7-4d6e-ba0d-7e33e37869e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.117812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d12244fb-eed7-4d6e-ba0d-7e33e37869e2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:28.119043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d12244fb-eed7-4d6e-ba0d-7e33e37869e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:28.128603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 505/1006] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:28.156330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12206a2f-358a-425e-a63f-939f004aa0e3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.171566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12206a2f-358a-425e-a63f-939f004aa0e3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.177035 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.177906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.178177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.178451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.191397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:28.199044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 03:05:28.200355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 502/1007] 10.222.0.31 () {56 vars in 1141 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:28.207741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12244fb-eed7-4d6e-ba0d-7e33e37869e2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.218173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12244fb-eed7-4d6e-ba0d-7e33e37869e2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.223453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.224151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.224433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.224704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.225529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:28.225884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.227501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.237245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 506/1008] 10.222.0.31 () {56 vars in 1136 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:28.243850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.256353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c36dfc-ebe5-4c52-8141-6e5444f3a559 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.262569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.263395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.264436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.264719 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.276333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.278333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.306662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:28.307942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 503/1009] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:28.314730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.325480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f60a3-f495-4aab-ad98-562a26d32c40 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.330982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.331628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.331906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.332176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.332933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:28.333229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.334864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.352775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 507/1010] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:28.354078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.364503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e04caf-e138-4eae-9fd6-df41402130a7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.369852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.370632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.370907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.371169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.378886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.380903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.394409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:05:28.395592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 504/1011] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:28.402198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.412901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47e54a-2da5-4abd-b674-85831538b9e7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.417931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.418585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.418862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.419131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.420337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:28.420639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.423552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.440233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 508/1012] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:28.446388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.456709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba16af-51da-4d16-9556-41d16ef5d229 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.461368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.462173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.462443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.462709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.473455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.475308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.492645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:28.493860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 505/1013] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:28.500463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.511285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba726631-a8bb-4db7-a8fa-727085b1c793 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.517330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.518099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.518437 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.518765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.519565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:28.519931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.521614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.534149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 509/1014] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:28.540625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.550494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93065e81-e1b0-4ab4-b5f5-415d5fa51350 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.555306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.556106 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.556380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.556650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.564090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.566110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.580839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:28.582279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 506/1015] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:28.588868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.599312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310e1ea1-9979-43a1-9cca-90465ee4dc95 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.604368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212e9cc-5395-40c1-b785-ee346b3f3122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.604945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212e9cc-5395-40c1-b785-ee346b3f3122 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.605222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212e9cc-5395-40c1-b785-ee346b3f3122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.605510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212e9cc-5395-40c1-b785-ee346b3f3122 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.606289 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212e9cc-5395-40c1-b785-ee346b3f3122 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:28.606591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212e9cc-5395-40c1-b785-ee346b3f3122 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.608582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212e9cc-5395-40c1-b785-ee346b3f3122 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.620495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 510/1016] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:28.627501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:28.637948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c79e02-a41f-43ca-8f1a-a632a68e9d58 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:28.642715 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb48ba-94e4-4b63-9996-ed1686ecaed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:28.643581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb48ba-94e4-4b63-9996-ed1686ecaed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:28.643858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb48ba-94e4-4b63-9996-ed1686ecaed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:28.644116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb48ba-94e4-4b63-9996-ed1686ecaed0 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/cf258dbbf82147618bc5310aebd91a65/roles/2d69a9c6be9d41cdb97f566f3bc77f75` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:28.646404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb48ba-94e4-4b63-9996-ed1686ecaed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=cf258dbbf82147618bc5310aebd91a65, role_id=2d69a9c6be9d41cdb97f566f3bc77f75)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:28.649019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb48ba-94e4-4b63-9996-ed1686ecaed0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:28.663147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 507/1017] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:05:28 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/cf258dbbf82147618bc5310aebd91a65/roles/2d69a9c6be9d41cdb97f566f3bc77f75 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:05:29.183410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c226d3-4b34-4e9f-bc6f-7ee9068e1b67 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:29.183980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c226d3-4b34-4e9f-bc6f-7ee9068e1b67 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:29.183980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c226d3-4b34-4e9f-bc6f-7ee9068e1b67 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:29.185964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 511/1018] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:29.192407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845619e0-36c5-4910-bf31-d52cef326ab9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:29.192849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845619e0-36c5-4910-bf31-d52cef326ab9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:29.193066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845619e0-36c5-4910-bf31-d52cef326ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:29.211396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-845619e0-36c5-4910-bf31-d52cef326ab9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:29.212599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-845619e0-36c5-4910-bf31-d52cef326ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:29.271969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 508/1019] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:05:29.296809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c226d3-4b34-4e9f-bc6f-7ee9068e1b67 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:29.311582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c226d3-4b34-4e9f-bc6f-7ee9068e1b67 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:29.316278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:29.317082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:29.317359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:29.317671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:29.328114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:29.334901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:05:29.336083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 512/1020] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:29.343953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845619e0-36c5-4910-bf31-d52cef326ab9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:29.353372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845619e0-36c5-4910-bf31-d52cef326ab9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:29.359863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:29.360536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:29.360818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:29.361091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:29.361914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:29.362217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:29.363843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:29.372821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 509/1021] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:29.379678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:29.390976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b678275-1f04-4abb-ba89-3bf267027d39 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:29.396093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:29.396946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:29.397222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:29.397517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] PATH_INFO: `/v3/users/6968a0a3ff794e22946a23b0f7241c3b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:29.398746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=6968a0a3ff794e22946a23b0f7241c3b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:29.400878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:29.402581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 513/1022] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:29 2021] GET /identity/v3/users/6968a0a3ff794e22946a23b0f7241c3b => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:29.409372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:29.419720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72db304-7d8d-4e13-a99b-9108be42deaf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:29.424529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76cece8-ccf9-484a-b07e-0759e7c572e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:29.425487 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cece8-ccf9-484a-b07e-0759e7c572e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:29.425773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cece8-ccf9-484a-b07e-0759e7c572e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:29.426044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76cece8-ccf9-484a-b07e-0759e7c572e4 admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:29.427255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cece8-ccf9-484a-b07e-0759e7c572e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7cbb7c9a7c044468e353ee1840b9679)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:29.429321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76cece8-ccf9-484a-b07e-0759e7c572e4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:29.431064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 510/1023] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:29 2021] GET /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:29.438044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:29.447836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e3a1e-ea77-405e-a43a-ee60fcea43c4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:29.452639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb093b3-a89f-460c-bb62-da436d042f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:29.453603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb093b3-a89f-460c-bb62-da436d042f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:29.453885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb093b3-a89f-460c-bb62-da436d042f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:29.454157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb093b3-a89f-460c-bb62-da436d042f98 admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679/users/6968a0a3ff794e22946a23b0f7241c3b/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:29.456186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb093b3-a89f-460c-bb62-da436d042f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7cbb7c9a7c044468e353ee1840b9679, user_id=6968a0a3ff794e22946a23b0f7241c3b, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:29.458870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb093b3-a89f-460c-bb62-da436d042f98 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:29.473377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 514/1024] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:05:29 2021] PUT /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679/users/6968a0a3ff794e22946a23b0f7241c3b/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:05:30.945115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f9205-dee9-49d9-8c1b-f0a25110b475 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:30.945677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f9205-dee9-49d9-8c1b-f0a25110b475 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:30.945677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f9205-dee9-49d9-8c1b-f0a25110b475 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:30.947517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 511/1025] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:30.953838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d5f5-0a76-47c3-af01-322ea1866a68 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:30.954306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d5f5-0a76-47c3-af01-322ea1866a68 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:30.954392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5548d5f5-0a76-47c3-af01-322ea1866a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:30.972353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5548d5f5-0a76-47c3-af01-322ea1866a68 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:30.973569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5548d5f5-0a76-47c3-af01-322ea1866a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:31.031733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 515/1026] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:31.057618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f9205-dee9-49d9-8c1b-f0a25110b475 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.071794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f9205-dee9-49d9-8c1b-f0a25110b475 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.076965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.077882 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.078132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.078410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.089118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:31.096434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 16 03:05:31.097653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 512/1027] 10.222.0.31 () {56 vars in 1141 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:31.104461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d5f5-0a76-47c3-af01-322ea1866a68 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.114131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5548d5f5-0a76-47c3-af01-322ea1866a68 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.119956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.120618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.120889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.121151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.121952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:31.122253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.123996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.132812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 516/1028] 10.222.0.31 () {56 vars in 1136 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:31.139851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.151044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcce7-a5e2-4888-93b1-d5dbb589be55 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.156986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.157808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.158093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.158363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.169950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.171915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.189468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:31.190691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 513/1029] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:31.197290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.207492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde4432-47a6-47d4-b86d-2652f6bcda5a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.212514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.213161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.213464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.213730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.214487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:31.214792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.216517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.228670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 517/1030] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:31.235204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.245721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378705c-bd8a-41ba-90f8-ab8e126c2b1a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.251515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.252325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.252610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.252862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.260883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.262934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.277550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 16 03:05:31.278839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 514/1031] 10.222.0.31 () {56 vars in 1114 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:31.285952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.296516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23cdcd-42ed-44c0-8cc4-23d421b86c7b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.301546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.302212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.302491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.302770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.303626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:31.303931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.305819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.323672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 518/1032] 10.222.0.31 () {56 vars in 1154 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:31.330558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.340972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a05636-4544-47f4-8a4c-c23878ea9379 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.358053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.358589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.359157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.359157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.368277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.370071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.380573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 515/1033] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:31.387295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.398150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ab46-d054-41f1-bfde-9e26e1652b1e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.404318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.404900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.405181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.405464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.417170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.419102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.438252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:05:31.439491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 519/1034] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:31.446149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.455929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffbba1-dea6-4dd8-9fff-b9cffb257903 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.461806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.462577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.462862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.463137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.463881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:31.464188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.465867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.479004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 516/1035] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:31.485477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.495898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ce78b-6cc9-4b76-bada-83bdd4ac4872 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.501462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.502256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.502546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.502819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.510161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.512153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.525090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:05:31.526302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 520/1036] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:31.533220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.543404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8c1d5-d157-4d5d-b61b-4b26a9b77e5e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.548480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7628a0-e762-4495-99c2-36df6eaa2133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.549126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7628a0-e762-4495-99c2-36df6eaa2133 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.549406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7628a0-e762-4495-99c2-36df6eaa2133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.549739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7628a0-e762-4495-99c2-36df6eaa2133 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.550533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7628a0-e762-4495-99c2-36df6eaa2133 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:31.550860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7628a0-e762-4495-99c2-36df6eaa2133 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.552704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7628a0-e762-4495-99c2-36df6eaa2133 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.565238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 517/1037] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:31.572129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.583086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cf892-b39a-433b-8f05-67b17a6146d5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.587956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3eba5-f81b-4dc8-a0cd-cdc4d9a5a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.588634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3eba5-f81b-4dc8-a0cd-cdc4d9a5a8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.588906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3eba5-f81b-4dc8-a0cd-cdc4d9a5a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.589173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3eba5-f81b-4dc8-a0cd-cdc4d9a5a8e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.590157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3eba5-f81b-4dc8-a0cd-cdc4d9a5a8e5 admin admin] RBAC: Adding query filter params (role.id=2d69a9c6be9d41cdb97f566f3bc77f75, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=cf258dbbf82147618bc5310aebd91a65) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:31.590462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3eba5-f81b-4dc8-a0cd-cdc4d9a5a8e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.592407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3eba5-f81b-4dc8-a0cd-cdc4d9a5a8e5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.599309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 521/1038] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/role_assignments?user.id=cf258dbbf82147618bc5310aebd91a65&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=2d69a9c6be9d41cdb97f566f3bc77f75 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:31.760631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530634f7-5c50-47fe-8dc8-5403e5caed3e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.760892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530634f7-5c50-47fe-8dc8-5403e5caed3e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.761177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530634f7-5c50-47fe-8dc8-5403e5caed3e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.763077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 518/1039] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:31.770356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4621-a5b1-4574-86a0-10da667b02d9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.770618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4621-a5b1-4574-86a0-10da667b02d9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.770901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4621-a5b1-4574-86a0-10da667b02d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.791734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-186b4621-a5b1-4574-86a0-10da667b02d9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:31.792983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-186b4621-a5b1-4574-86a0-10da667b02d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:31.802003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 522/1040] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:31.827323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530634f7-5c50-47fe-8dc8-5403e5caed3e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.841748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530634f7-5c50-47fe-8dc8-5403e5caed3e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.846779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.847580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.847856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.848125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.859154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:31.865984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:05:31.867211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 519/1041] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:31.874128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b4621-a5b1-4574-86a0-10da667b02d9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.883588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b4621-a5b1-4574-86a0-10da667b02d9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.888579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.889459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.889780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.890039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.890808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:31.891114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.892738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.901850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 523/1042] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:31.908636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.921621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ea870-916a-4db8-8efa-dab4c918493f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.928294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.929172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.929502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.929761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] PATH_INFO: `/v3/users/6968a0a3ff794e22946a23b0f7241c3b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.931152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] RBAC: Authorizing `identity:get_user(user_id=6968a0a3ff794e22946a23b0f7241c3b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.934335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.936945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 520/1043] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/users/6968a0a3ff794e22946a23b0f7241c3b => generated 285 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:31.944368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.954998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d221af-5cd3-43df-b50b-2052168bfb72 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:31.960110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:31.960763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:31.961046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:31.961319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:31.971845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:31.972036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:31.981657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 524/1044] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:31.988623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:31.998717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3b00b-ab36-46bb-8208-37626624ca10 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:32.003514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8aba69-c33a-44f5-bd56-28be72fe4b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:32.004379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aba69-c33a-44f5-bd56-28be72fe4b35 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:32.004674 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aba69-c33a-44f5-bd56-28be72fe4b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:32.004949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8aba69-c33a-44f5-bd56-28be72fe4b35 admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:32.006175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aba69-c33a-44f5-bd56-28be72fe4b35 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7cbb7c9a7c044468e353ee1840b9679)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:32.008247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8aba69-c33a-44f5-bd56-28be72fe4b35 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:32.010006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 521/1045] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:31 2021] GET /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:32.017343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:32.026630 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe166959-7d12-4327-9330-00a6dd9b8348 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:32.031519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c410c-15a2-400d-a62c-ca9b9ad493f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:32.032176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c410c-15a2-400d-a62c-ca9b9ad493f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:32.032460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c410c-15a2-400d-a62c-ca9b9ad493f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:32.032734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c410c-15a2-400d-a62c-ca9b9ad493f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:32.033663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c410c-15a2-400d-a62c-ca9b9ad493f0 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=a7cbb7c9a7c044468e353ee1840b9679, user.id=6968a0a3ff794e22946a23b0f7241c3b) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:32.033977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c410c-15a2-400d-a62c-ca9b9ad493f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:32.036205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c410c-15a2-400d-a62c-ca9b9ad493f0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:32.042526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 525/1046] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:32 2021] GET /identity/v3/role_assignments?user.id=6968a0a3ff794e22946a23b0f7241c3b&scope.project.id=a7cbb7c9a7c044468e353ee1840b9679&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:34.564913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5066f3-c3d5-4df1-85fa-fbcfe392ed87 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:34.565625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5066f3-c3d5-4df1-85fa-fbcfe392ed87 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:34.565870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5066f3-c3d5-4df1-85fa-fbcfe392ed87 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:34.568728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 522/1047] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:34.576186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173744b-7550-459c-a2bf-4054d2961f34 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:34.576746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173744b-7550-459c-a2bf-4054d2961f34 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:34.576746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173744b-7550-459c-a2bf-4054d2961f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:34.596781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f173744b-7550-459c-a2bf-4054d2961f34 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:34.598073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f173744b-7550-459c-a2bf-4054d2961f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:34.608727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 526/1048] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:34 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:34.636608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5066f3-c3d5-4df1-85fa-fbcfe392ed87 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:34.651041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5066f3-c3d5-4df1-85fa-fbcfe392ed87 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:34.656410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce161af6-3fbe-4bfc-bfbe-7bc432d55017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:34.657197 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce161af6-3fbe-4bfc-bfbe-7bc432d55017 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:34.657543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce161af6-3fbe-4bfc-bfbe-7bc432d55017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:34.657807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce161af6-3fbe-4bfc-bfbe-7bc432d55017 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:34.659091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce161af6-3fbe-4bfc-bfbe-7bc432d55017 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:34.661153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce161af6-3fbe-4bfc-bfbe-7bc432d55017 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:34.662802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 523/1049] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:34.669580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173744b-7550-459c-a2bf-4054d2961f34 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:34.678819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173744b-7550-459c-a2bf-4054d2961f34 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:34.683882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb2d8-59bd-4aed-af41-21b882646acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:34.684512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb2d8-59bd-4aed-af41-21b882646acd admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:34.684796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb2d8-59bd-4aed-af41-21b882646acd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:34.685098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb2d8-59bd-4aed-af41-21b882646acd admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:34.685923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb2d8-59bd-4aed-af41-21b882646acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:34.687829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb2d8-59bd-4aed-af41-21b882646acd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:34.709100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 527/1050] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:05:34 2021] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:37.066488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2d74f-9212-45a1-b4db-a46b8f3195d5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:37.067079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2d74f-9212-45a1-b4db-a46b8f3195d5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:37.067079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2d74f-9212-45a1-b4db-a46b8f3195d5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:37.068835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 524/1051] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:37.075115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18b6b-bcaf-4861-982a-6d913d867219 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:37.075647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18b6b-bcaf-4861-982a-6d913d867219 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:37.075807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be18b6b-bcaf-4861-982a-6d913d867219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:37.094882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1be18b6b-bcaf-4861-982a-6d913d867219 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:37.096056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1be18b6b-bcaf-4861-982a-6d913d867219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:37.105468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 528/1052] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:37.131183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2d74f-9212-45a1-b4db-a46b8f3195d5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:37.144207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2d74f-9212-45a1-b4db-a46b8f3195d5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:37.149192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:37.150065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:37.150346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:37.150620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] PATH_INFO: `/v3/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:37.152160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] RBAC: Authorizing `identity:get_role(role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:37.153185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:05:37.153185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:05:37.153185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:05:37.154165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:37.155500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 525/1053] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:37 2021] GET /identity/v3/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:37.162175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be18b6b-bcaf-4861-982a-6d913d867219 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:37.171381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be18b6b-bcaf-4861-982a-6d913d867219 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:37.176401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:37.177260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:37.177573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:37.177850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] PATH_INFO: `/v3/users/33fe01bc6fae4e289463ec8d5827818d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:37.192196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] RBAC: Authorizing `identity:get_user(user_id=33fe01bc6fae4e289463ec8d5827818d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:37.194378 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:37.196024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 529/1054] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:37 2021] GET /identity/v3/users/33fe01bc6fae4e289463ec8d5827818d => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:37.202518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:37.212745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914b7ce-d9c7-446e-9ade-e369320c57e7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:37.218689 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:37.219322 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:37.219599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:37.219863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:37.228302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:37.230095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:37.239581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 526/1055] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:37 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:37.246541 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:37.256845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260e588-d10d-4424-ac56-56b2117189ec admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:37.262258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e9347-c936-4f47-914c-335c7f2a63b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:37.263304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e9347-c936-4f47-914c-335c7f2a63b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:37.263781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e9347-c936-4f47-914c-335c7f2a63b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:37.264063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e9347-c936-4f47-914c-335c7f2a63b9 admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:37.265332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e9347-c936-4f47-914c-335c7f2a63b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7cbb7c9a7c044468e353ee1840b9679)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:37.267417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e9347-c936-4f47-914c-335c7f2a63b9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:37.269043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 530/1056] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:37 2021] GET /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:37.275948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:37.285397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfd60b-a091-4a9c-8aa6-8ff8623a0006 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:37.291631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae201c-c3ef-46ce-aafc-6ff27ac780f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:37.292274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae201c-c3ef-46ce-aafc-6ff27ac780f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:37.292546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae201c-c3ef-46ce-aafc-6ff27ac780f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:37.292818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae201c-c3ef-46ce-aafc-6ff27ac780f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:37.293694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae201c-c3ef-46ce-aafc-6ff27ac780f7 admin admin] RBAC: Adding query filter params (role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=a7cbb7c9a7c044468e353ee1840b9679, user.id=33fe01bc6fae4e289463ec8d5827818d) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:37.293998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae201c-c3ef-46ce-aafc-6ff27ac780f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:37.296076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae201c-c3ef-46ce-aafc-6ff27ac780f7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:37.301967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 527/1057] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:37 2021] GET /identity/v3/role_assignments?user.id=33fe01bc6fae4e289463ec8d5827818d&scope.project.id=a7cbb7c9a7c044468e353ee1840b9679&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:39.547965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aac92-a74f-4a78-9c54-69e70c7089b5 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:39.548570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aac92-a74f-4a78-9c54-69e70c7089b5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:39.548570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aac92-a74f-4a78-9c54-69e70c7089b5 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:39.550311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 531/1058] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:39.556480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbabea-a668-4c60-bc7c-80f5cbd49fc0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:39.556962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbabea-a668-4c60-bc7c-80f5cbd49fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:39.556962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbabea-a668-4c60-bc7c-80f5cbd49fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:39.575668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7cbbabea-a668-4c60-bc7c-80f5cbd49fc0 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:39.577001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7cbbabea-a668-4c60-bc7c-80f5cbd49fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:39.586458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 528/1059] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:39.610564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4aac92-a74f-4a78-9c54-69e70c7089b5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:39.624807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4aac92-a74f-4a78-9c54-69e70c7089b5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:39.629919 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:39.630771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:39.631056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:39.631332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] PATH_INFO: `/v3/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:39.633223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] RBAC: Authorizing `identity:get_role(role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:39.634299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:05:39.634299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:05:39.634299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:05:39.635187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:39.636548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 532/1060] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:39 2021] GET /identity/v3/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:39.643328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbabea-a668-4c60-bc7c-80f5cbd49fc0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:39.652480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbabea-a668-4c60-bc7c-80f5cbd49fc0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:39.657567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:39.658419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:39.658696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:39.658958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] PATH_INFO: `/v3/users/33fe01bc6fae4e289463ec8d5827818d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:39.660202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] RBAC: Authorizing `identity:get_user(user_id=33fe01bc6fae4e289463ec8d5827818d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:39.662749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:39.664328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 529/1061] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:39 2021] GET /identity/v3/users/33fe01bc6fae4e289463ec8d5827818d => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:05:39.670988 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:39.681270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc0a15-4a96-46b7-bb9e-dff2f85fbf8f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:39.686902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b9205-3584-4e02-bed0-e8189d0dc5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:39.687743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9205-3584-4e02-bed0-e8189d0dc5fd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:39.688025 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9205-3584-4e02-bed0-e8189d0dc5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:39.688298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b9205-3584-4e02-bed0-e8189d0dc5fd admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:39.689653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9205-3584-4e02-bed0-e8189d0dc5fd admin admin] RBAC: Authorizing `identity:get_project(project_id=a7cbb7c9a7c044468e353ee1840b9679)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:39.691696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b9205-3584-4e02-bed0-e8189d0dc5fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:39.693359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 533/1062] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:39 2021] GET /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:39.699800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:39.709412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f59f3d-0ed4-441f-9bd6-0d2256490ebf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:39.714366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cb261-1331-4f14-ba8e-1c3a7132c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:39.715207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb261-1331-4f14-ba8e-1c3a7132c371 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:39.715484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb261-1331-4f14-ba8e-1c3a7132c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:39.715748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cb261-1331-4f14-ba8e-1c3a7132c371 admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679/users/33fe01bc6fae4e289463ec8d5827818d/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:39.718343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cb261-1331-4f14-ba8e-1c3a7132c371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7cbb7c9a7c044468e353ee1840b9679, user_id=33fe01bc6fae4e289463ec8d5827818d, role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:39.720915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cb261-1331-4f14-ba8e-1c3a7132c371 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:39.735525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 530/1063] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:05:39 2021] PUT /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679/users/33fe01bc6fae4e289463ec8d5827818d/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:05:41.991371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50c89d-66d8-4c38-b14a-a52cb86549b1 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:41.991929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50c89d-66d8-4c38-b14a-a52cb86549b1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:41.991929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae50c89d-66d8-4c38-b14a-a52cb86549b1 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:41.993718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 534/1064] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:42.000171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810526-5830-4296-8483-926e5be95ab3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:42.000661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810526-5830-4296-8483-926e5be95ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:42.000661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55810526-5830-4296-8483-926e5be95ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:42.020478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-55810526-5830-4296-8483-926e5be95ab3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:42.021700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-55810526-5830-4296-8483-926e5be95ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:42.083163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 531/1065] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:42.108254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50c89d-66d8-4c38-b14a-a52cb86549b1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:42.122473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae50c89d-66d8-4c38-b14a-a52cb86549b1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:42.127553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:42.128395 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:42.128681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:42.128950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] PATH_INFO: `/v3/roles/bc0b3359e27444de9f64d77cecd54f33` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:42.130496 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] RBAC: Authorizing `identity:get_role(role_id=bc0b3359e27444de9f64d77cecd54f33)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:42.132077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:42.133419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 535/1066] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:42 2021] GET /identity/v3/roles/bc0b3359e27444de9f64d77cecd54f33 => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:42.140253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55810526-5830-4296-8483-926e5be95ab3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:42.149623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55810526-5830-4296-8483-926e5be95ab3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:42.155542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:42.156413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:42.156684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:42.156952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] PATH_INFO: `/v3/users/33fe01bc6fae4e289463ec8d5827818d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:42.158317 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] RBAC: Authorizing `identity:get_user(user_id=33fe01bc6fae4e289463ec8d5827818d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:42.160445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:42.162420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 532/1067] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:42 2021] GET /identity/v3/users/33fe01bc6fae4e289463ec8d5827818d => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:42.168788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:42.178997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b455bc-7040-4397-b9a8-c5f7d3add0bd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:42.184818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:42.185426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:42.185737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:42.186005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:42.194326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:42.196064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:42.205673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 536/1068] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:42 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:42.212969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:42.223619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f5d98-dc5a-4d9f-87a2-606ea802e6ef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:42.229451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262da0c3-64b4-4375-8e0c-7a41c37cffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:42.230315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da0c3-64b4-4375-8e0c-7a41c37cffd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:42.230592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da0c3-64b4-4375-8e0c-7a41c37cffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:42.230861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262da0c3-64b4-4375-8e0c-7a41c37cffd9 admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:42.232624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262da0c3-64b4-4375-8e0c-7a41c37cffd9 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7cbb7c9a7c044468e353ee1840b9679)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:42.234721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262da0c3-64b4-4375-8e0c-7a41c37cffd9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:42.236399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 533/1069] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:42 2021] GET /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:42.243125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:42.252587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaca062-20e6-48a4-b57e-6d54102b4ec3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:42.257990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81605d3-0bb5-481a-bf17-d09d15611577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:42.258626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81605d3-0bb5-481a-bf17-d09d15611577 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:42.258901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81605d3-0bb5-481a-bf17-d09d15611577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:42.259175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81605d3-0bb5-481a-bf17-d09d15611577 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:42.260010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81605d3-0bb5-481a-bf17-d09d15611577 admin admin] RBAC: Adding query filter params (role.id=bc0b3359e27444de9f64d77cecd54f33, scope.project.id=a7cbb7c9a7c044468e353ee1840b9679, user.id=33fe01bc6fae4e289463ec8d5827818d) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:42.260315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81605d3-0bb5-481a-bf17-d09d15611577 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:42.262182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81605d3-0bb5-481a-bf17-d09d15611577 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:42.268507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 537/1070] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:42 2021] GET /identity/v3/role_assignments?user.id=33fe01bc6fae4e289463ec8d5827818d&scope.project.id=a7cbb7c9a7c044468e353ee1840b9679&role.id=bc0b3359e27444de9f64d77cecd54f33 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:44.580386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38448c-c4a1-4385-9066-13a05cf2f329 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:44.580941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38448c-c4a1-4385-9066-13a05cf2f329 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:44.580941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38448c-c4a1-4385-9066-13a05cf2f329 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:44.582733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 534/1071] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:44.589246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f67e5-1b6c-4722-bce4-55fecdd870d6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:44.589683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f67e5-1b6c-4722-bce4-55fecdd870d6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:44.589840 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f67e5-1b6c-4722-bce4-55fecdd870d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:44.608509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-097f67e5-1b6c-4722-bce4-55fecdd870d6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:44.609741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-097f67e5-1b6c-4722-bce4-55fecdd870d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:44.617880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 538/1072] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:44.643186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38448c-c4a1-4385-9066-13a05cf2f329 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:44.656979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38448c-c4a1-4385-9066-13a05cf2f329 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:44.662233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137b621-5295-4b93-ace8-d5a229204477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:44.663019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137b621-5295-4b93-ace8-d5a229204477 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:44.663288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137b621-5295-4b93-ace8-d5a229204477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:44.663555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137b621-5295-4b93-ace8-d5a229204477 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:44.664756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137b621-5295-4b93-ace8-d5a229204477 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:44.666483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137b621-5295-4b93-ace8-d5a229204477 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:44.668074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 535/1073] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:44.674945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f67e5-1b6c-4722-bce4-55fecdd870d6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:44.684479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f67e5-1b6c-4722-bce4-55fecdd870d6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:44.690035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fab50-8b5d-455c-9ce2-6305ac59d178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:44.690687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fab50-8b5d-455c-9ce2-6305ac59d178 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:44.690971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fab50-8b5d-455c-9ce2-6305ac59d178 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:44.691241 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fab50-8b5d-455c-9ce2-6305ac59d178 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:44.691960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fab50-8b5d-455c-9ce2-6305ac59d178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:44.693899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4fab50-8b5d-455c-9ce2-6305ac59d178 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:44.722509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 539/1074] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:05:44 2021] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:47.054227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bace6-e56a-4e94-a957-927958edb7d7 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:47.054767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bace6-e56a-4e94-a957-927958edb7d7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:47.054767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bace6-e56a-4e94-a957-927958edb7d7 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:47.056577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 536/1075] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:47.063194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813c67f-ef3d-4fab-8b48-0e7e900b311e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:47.063670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813c67f-ef3d-4fab-8b48-0e7e900b311e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:47.063761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813c67f-ef3d-4fab-8b48-0e7e900b311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:47.082621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8813c67f-ef3d-4fab-8b48-0e7e900b311e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:47.083737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8813c67f-ef3d-4fab-8b48-0e7e900b311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:47.144271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 540/1076] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:47.171095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bace6-e56a-4e94-a957-927958edb7d7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:47.184033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bace6-e56a-4e94-a957-927958edb7d7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:47.188974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56370071-4e9c-41d6-86f2-cd11a5460937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:47.189799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56370071-4e9c-41d6-86f2-cd11a5460937 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:47.190073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56370071-4e9c-41d6-86f2-cd11a5460937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:47.190341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56370071-4e9c-41d6-86f2-cd11a5460937 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:47.191565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56370071-4e9c-41d6-86f2-cd11a5460937 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:47.193248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56370071-4e9c-41d6-86f2-cd11a5460937 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:47.194881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 537/1077] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:05:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:47.201749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813c67f-ef3d-4fab-8b48-0e7e900b311e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:47.211345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813c67f-ef3d-4fab-8b48-0e7e900b311e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:47.217585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c8c8e-9dcd-42d9-89c1-e7f9a6c7274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:47.218255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8c8e-9dcd-42d9-89c1-e7f9a6c7274f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:47.218533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8c8e-9dcd-42d9-89c1-e7f9a6c7274f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:47.218801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c8c8e-9dcd-42d9-89c1-e7f9a6c7274f admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:47.219531 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c8c8e-9dcd-42d9-89c1-e7f9a6c7274f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:47.221523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c8c8e-9dcd-42d9-89c1-e7f9a6c7274f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:47.242812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 541/1078] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:05:47 2021] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:05:49.572116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa3f2-277b-4d01-bdf2-ad8cf1ae7103 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.572718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa3f2-277b-4d01-bdf2-ad8cf1ae7103 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.572718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fa3f2-277b-4d01-bdf2-ad8cf1ae7103 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.574472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 538/1079] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:49.580850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954710-9a0d-474f-93b0-16032870f95c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.581309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954710-9a0d-474f-93b0-16032870f95c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.581416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3954710-9a0d-474f-93b0-16032870f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.600697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d3954710-9a0d-474f-93b0-16032870f95c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:49.602045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d3954710-9a0d-474f-93b0-16032870f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:49.611513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 542/1080] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:49 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:49.636158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa3f2-277b-4d01-bdf2-ad8cf1ae7103 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:49.650718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fa3f2-277b-4d01-bdf2-ad8cf1ae7103 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:49.656043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:49.656833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.657117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.657386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.668875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:49.675764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:05:49.676980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 539/1081] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:49.683973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3954710-9a0d-474f-93b0-16032870f95c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:49.693462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3954710-9a0d-474f-93b0-16032870f95c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:49.699277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:49.699945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.700390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.700658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.701447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:49.701762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:49.703474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:49.712480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 543/1082] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:49.719544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:49.730370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e9904-81b8-4589-911a-97e224513248 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:49.736413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:49.737276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.737590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.737861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] PATH_INFO: `/v3/users/08ada2c851604c33a82b81e92de36d90` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.753615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] RBAC: Authorizing `identity:get_user(user_id=08ada2c851604c33a82b81e92de36d90)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:49.756060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:49.757824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 540/1083] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:49 2021] GET /identity/v3/users/08ada2c851604c33a82b81e92de36d90 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:49.765968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:49.776441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa7db6-a0e8-4686-91eb-a76f853051cb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:49.782525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:49.783162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.783435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.783701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.792422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:49.794530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:49.805348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 544/1084] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:49 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:49.813537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:49.824029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a5937-5deb-40be-bcd9-c69c307c05ef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:49.829654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084a55b-8ddf-4bf5-87af-e4a9522f6115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:49.830514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a55b-8ddf-4bf5-87af-e4a9522f6115 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.830795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a55b-8ddf-4bf5-87af-e4a9522f6115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.831066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084a55b-8ddf-4bf5-87af-e4a9522f6115 admin admin] PATH_INFO: `/v3/projects/34c85d80dd524131aedfb552ce8fe0fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.832393 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a55b-8ddf-4bf5-87af-e4a9522f6115 admin admin] RBAC: Authorizing `identity:get_project(project_id=34c85d80dd524131aedfb552ce8fe0fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:49.834536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084a55b-8ddf-4bf5-87af-e4a9522f6115 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:49.836214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 541/1085] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:49 2021] GET /identity/v3/projects/34c85d80dd524131aedfb552ce8fe0fe => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:49.843136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:49.852144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e60f1a-f637-4329-8f9a-a4b185828d5b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:49.857513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b240b5-b3eb-4cf9-abec-1ab6e94e5ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:49.858228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b240b5-b3eb-4cf9-abec-1ab6e94e5ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:49.858529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b240b5-b3eb-4cf9-abec-1ab6e94e5ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:49.858799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b240b5-b3eb-4cf9-abec-1ab6e94e5ac1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:49.859597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b240b5-b3eb-4cf9-abec-1ab6e94e5ac1 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=34c85d80dd524131aedfb552ce8fe0fe, user.id=08ada2c851604c33a82b81e92de36d90) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:49.859897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b240b5-b3eb-4cf9-abec-1ab6e94e5ac1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:49.861796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b240b5-b3eb-4cf9-abec-1ab6e94e5ac1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:49.867635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 545/1086] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:49 2021] GET /identity/v3/role_assignments?user.id=08ada2c851604c33a82b81e92de36d90&scope.project.id=34c85d80dd524131aedfb552ce8fe0fe&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:52.116176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3972f8-f941-4a40-8975-96607c665c21 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:52.116725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3972f8-f941-4a40-8975-96607c665c21 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:52.116725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3972f8-f941-4a40-8975-96607c665c21 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:52.118438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 542/1087] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:52.124648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657528-c7b4-4c09-840b-aafcdedaf23e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:52.125141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657528-c7b4-4c09-840b-aafcdedaf23e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:52.125141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1657528-c7b4-4c09-840b-aafcdedaf23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:52.144656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c1657528-c7b4-4c09-840b-aafcdedaf23e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:52.145904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1657528-c7b4-4c09-840b-aafcdedaf23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:52.155416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 546/1088] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:52 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:52.179582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3972f8-f941-4a40-8975-96607c665c21 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:52.192729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3972f8-f941-4a40-8975-96607c665c21 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:52.198885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:52.199714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:52.199992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:52.200335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:52.213730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:52.221097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:05:52.222336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 543/1089] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:52.229612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1657528-c7b4-4c09-840b-aafcdedaf23e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:52.239245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1657528-c7b4-4c09-840b-aafcdedaf23e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:52.244300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:52.244959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:52.245236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:52.245529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:52.246299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:52.246602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:52.248329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:52.258123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 547/1090] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:52.265242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:52.276300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9c6d-00a7-4fb8-8fc9-5bef1a95bf72 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:52.282382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:52.283242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:52.283525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:52.283797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] PATH_INFO: `/v3/users/08ada2c851604c33a82b81e92de36d90` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:52.285172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=08ada2c851604c33a82b81e92de36d90)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:52.287723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:52.289353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 544/1091] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:52 2021] GET /identity/v3/users/08ada2c851604c33a82b81e92de36d90 => generated 286 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:52.296099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:52.306071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4d41b-cafe-44f7-96a7-2a8e67548e5b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:52.311063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95be2d1-b6f8-46af-9b06-0c67440ba59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:52.311905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95be2d1-b6f8-46af-9b06-0c67440ba59b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:52.312181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95be2d1-b6f8-46af-9b06-0c67440ba59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:52.312426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95be2d1-b6f8-46af-9b06-0c67440ba59b admin admin] PATH_INFO: `/v3/projects/34c85d80dd524131aedfb552ce8fe0fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:52.313709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95be2d1-b6f8-46af-9b06-0c67440ba59b admin admin] RBAC: Authorizing `identity:get_project(project_id=34c85d80dd524131aedfb552ce8fe0fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:52.315755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95be2d1-b6f8-46af-9b06-0c67440ba59b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:52.317409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 548/1092] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:52 2021] GET /identity/v3/projects/34c85d80dd524131aedfb552ce8fe0fe => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:52.324119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:52.334529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af2f2d-c211-4e86-99b1-df409ed54cb2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:52.340340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36050-38de-40b6-a46d-26196825538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:52.341418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36050-38de-40b6-a46d-26196825538d admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:52.341700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36050-38de-40b6-a46d-26196825538d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:52.341994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36050-38de-40b6-a46d-26196825538d admin admin] PATH_INFO: `/v3/projects/34c85d80dd524131aedfb552ce8fe0fe/users/08ada2c851604c33a82b81e92de36d90/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:52.344220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36050-38de-40b6-a46d-26196825538d admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c85d80dd524131aedfb552ce8fe0fe, user_id=08ada2c851604c33a82b81e92de36d90, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:52.346881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece36050-38de-40b6-a46d-26196825538d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:52.362087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 545/1093] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:05:52 2021] PUT /identity/v3/projects/34c85d80dd524131aedfb552ce8fe0fe/users/08ada2c851604c33a82b81e92de36d90/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:05:54.593865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f8c4-71eb-4ae6-835a-1086e19c1e0e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.594434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f8c4-71eb-4ae6-835a-1086e19c1e0e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.594434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f8c4-71eb-4ae6-835a-1086e19c1e0e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.596180 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 549/1094] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:54.602559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9457e-0229-4354-b55c-4489c4da99e4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.602984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9457e-0229-4354-b55c-4489c4da99e4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.603127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9457e-0229-4354-b55c-4489c4da99e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.621547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0dd9457e-0229-4354-b55c-4489c4da99e4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:54.622912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0dd9457e-0229-4354-b55c-4489c4da99e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:54.684893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 546/1095] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:54 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:54.710277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f8c4-71eb-4ae6-835a-1086e19c1e0e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:54.724746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f8c4-71eb-4ae6-835a-1086e19c1e0e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:54.730187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:54.730973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.731489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.731489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.742566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:05:54.749467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:05:54.750671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 550/1096] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:05:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:54.757596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9457e-0229-4354-b55c-4489c4da99e4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:54.767387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9457e-0229-4354-b55c-4489c4da99e4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:54.773226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:54.773929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.774208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.774474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.775233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:54.775533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:54.777162 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:54.786662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 547/1097] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:05:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:54.793228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:54.803741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2c168-feaf-49d5-82e7-4cdefc847929 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:54.809663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:54.810592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.810871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.811147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] PATH_INFO: `/v3/users/08ada2c851604c33a82b81e92de36d90` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.812501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=08ada2c851604c33a82b81e92de36d90)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:54.814756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:54.816385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 551/1098] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:05:54 2021] GET /identity/v3/users/08ada2c851604c33a82b81e92de36d90 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:54.823233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:54.834075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8496bf-dccf-4cb4-9212-e2d7ef9d6741 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:54.840023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:54.840668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.840970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.841218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.849965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:54.851660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:54.861459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 548/1099] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:54 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:54.868561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:54.880458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef4b41-c1a3-4a1f-ba07-b77b5a5f80d5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:54.886407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eaf5e-d257-44ec-8f33-7c95d4b3f593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:54.887269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaf5e-d257-44ec-8f33-7c95d4b3f593 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.887706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaf5e-d257-44ec-8f33-7c95d4b3f593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.887898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eaf5e-d257-44ec-8f33-7c95d4b3f593 admin admin] PATH_INFO: `/v3/projects/34c85d80dd524131aedfb552ce8fe0fe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.889243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993eaf5e-d257-44ec-8f33-7c95d4b3f593 admin admin] RBAC: Authorizing `identity:get_project(project_id=34c85d80dd524131aedfb552ce8fe0fe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:54.891358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993eaf5e-d257-44ec-8f33-7c95d4b3f593 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:54.893064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 552/1100] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:05:54 2021] GET /identity/v3/projects/34c85d80dd524131aedfb552ce8fe0fe => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:54.900431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:54.910878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a2885-7e54-4d5e-86d8-5fece868c01c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:54.916799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0667aa1-09be-4446-9fb4-3b22365d86c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:54.917473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0667aa1-09be-4446-9fb4-3b22365d86c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:54.917748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0667aa1-09be-4446-9fb4-3b22365d86c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:54.918018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0667aa1-09be-4446-9fb4-3b22365d86c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:54.919154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0667aa1-09be-4446-9fb4-3b22365d86c6 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=34c85d80dd524131aedfb552ce8fe0fe, user.id=08ada2c851604c33a82b81e92de36d90) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:54.919471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0667aa1-09be-4446-9fb4-3b22365d86c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:54.921324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0667aa1-09be-4446-9fb4-3b22365d86c6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:54.927611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 549/1101] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:05:54 2021] GET /identity/v3/role_assignments?user.id=08ada2c851604c33a82b81e92de36d90&scope.project.id=34c85d80dd524131aedfb552ce8fe0fe&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:57.232730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7f6f-9112-47f8-8f51-40e366550659 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:57.233284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7f6f-9112-47f8-8f51-40e366550659 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:57.233284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf7f6f-9112-47f8-8f51-40e366550659 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:57.235071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 553/1102] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:57.241677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b157b-b3d8-4b5b-93c7-b84368209031 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:57.242125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b157b-b3d8-4b5b-93c7-b84368209031 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:57.242214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b157b-b3d8-4b5b-93c7-b84368209031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:57.261559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ea8b157b-b3d8-4b5b-93c7-b84368209031 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:57.262975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ea8b157b-b3d8-4b5b-93c7-b84368209031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:57.271841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 550/1103] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:57 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:57.296116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf7f6f-9112-47f8-8f51-40e366550659 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:57.310714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf7f6f-9112-47f8-8f51-40e366550659 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:57.316205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:57.316848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:57.317131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:57.317403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:57.325592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:57.327363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:57.336042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 554/1104] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:05:57 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:05:57.343002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b157b-b3d8-4b5b-93c7-b84368209031 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:57.352265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b157b-b3d8-4b5b-93c7-b84368209031 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:57.357469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543f9d9-acde-4323-b1e9-322620be30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:57.358299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f9d9-acde-4323-b1e9-322620be30cf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:57.358582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f9d9-acde-4323-b1e9-322620be30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:57.358858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543f9d9-acde-4323-b1e9-322620be30cf admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:57.366065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f9d9-acde-4323-b1e9-322620be30cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:57.367911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543f9d9-acde-4323-b1e9-322620be30cf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:57.382593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-3543f9d9-acde-4323-b1e9-322620be30cf admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 16 03:05:57.383742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 551/1105] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:05:57 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:05:57.390662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:57.399792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bc30a-97e7-422f-9111-c86094cbe2ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:57.405952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0afa1a-f214-431e-9cb5-e7374c9faaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:57.406594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afa1a-f214-431e-9cb5-e7374c9faaef admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:57.406869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afa1a-f214-431e-9cb5-e7374c9faaef admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:57.407130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0afa1a-f214-431e-9cb5-e7374c9faaef admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:57.407855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0afa1a-f214-431e-9cb5-e7374c9faaef admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:05:57.408152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0afa1a-f214-431e-9cb5-e7374c9faaef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:57.409769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0afa1a-f214-431e-9cb5-e7374c9faaef admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:57.417530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 555/1106] 10.222.0.31 () {56 vars in 1136 bytes} [Tue Nov 16 03:05:57 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:05:59.696135 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e5e6-0055-4a98-b141-9a6b87615e66 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:59.696707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e5e6-0055-4a98-b141-9a6b87615e66 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:59.696707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66e5e6-0055-4a98-b141-9a6b87615e66 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:59.698465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 552/1107] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:05:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:05:59.706978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bde445-bc89-4cd1-a059-f4c4ee56aaef None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:59.707495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bde445-bc89-4cd1-a059-f4c4ee56aaef None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:59.707495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bde445-bc89-4cd1-a059-f4c4ee56aaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:59.726763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b8bde445-bc89-4cd1-a059-f4c4ee56aaef None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:05:59.727962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b8bde445-bc89-4cd1-a059-f4c4ee56aaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:05:59.737048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 556/1108] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:05:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:05:59.761765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66e5e6-0055-4a98-b141-9a6b87615e66 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:05:59.776212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66e5e6-0055-4a98-b141-9a6b87615e66 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:05:59.782353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34ae4-1bba-4f27-b2ab-06c90aaa7490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:05:59.783007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34ae4-1bba-4f27-b2ab-06c90aaa7490 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:05:59.783280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34ae4-1bba-4f27-b2ab-06c90aaa7490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:05:59.783545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34ae4-1bba-4f27-b2ab-06c90aaa7490 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:05:59.784297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34ae4-1bba-4f27-b2ab-06c90aaa7490 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:05:59.785306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-96a34ae4-1bba-4f27-b2ab-06c90aaa7490 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:05:59.785306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:05:59.785306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:05:59.786582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34ae4-1bba-4f27-b2ab-06c90aaa7490 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:05:59.803793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 553/1109] 10.222.0.31 () {60 vars in 1159 bytes} [Tue Nov 16 03:05:59 2021] POST /identity/v3/domains => generated 267 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:06:02.134938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756dcc-7fcf-44c5-b177-fc0682e67521 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:02.135491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756dcc-7fcf-44c5-b177-fc0682e67521 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:02.135491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e756dcc-7fcf-44c5-b177-fc0682e67521 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:02.137183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 557/1110] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:06:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:06:02.143504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee51ccb-9ac5-485b-b58d-1cc6241615b3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:02.143932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee51ccb-9ac5-485b-b58d-1cc6241615b3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:02.144021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee51ccb-9ac5-485b-b58d-1cc6241615b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:02.164597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8ee51ccb-9ac5-485b-b58d-1cc6241615b3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:06:02.165939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8ee51ccb-9ac5-485b-b58d-1cc6241615b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:06:02.227880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 554/1111] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:06:02 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:06:02.252731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e756dcc-7fcf-44c5-b177-fc0682e67521 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:02.267196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e756dcc-7fcf-44c5-b177-fc0682e67521 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:02.272440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fcf6f-eca8-4b31-971e-bb7041f026ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:02.273293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fcf6f-eca8-4b31-971e-bb7041f026ac admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:02.273698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fcf6f-eca8-4b31-971e-bb7041f026ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:02.273972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fcf6f-eca8-4b31-971e-bb7041f026ac admin admin] PATH_INFO: `/v3/domains/40159afa664e4c81b8f3e867a1d09858` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:02.286409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fcf6f-eca8-4b31-971e-bb7041f026ac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=40159afa664e4c81b8f3e867a1d09858)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:02.288383 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fcf6f-eca8-4b31-971e-bb7041f026ac admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:02.291064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 558/1112] 10.222.0.31 () {56 vars in 1204 bytes} [Tue Nov 16 03:06:02 2021] GET /identity/v3/domains/40159afa664e4c81b8f3e867a1d09858 => generated 267 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:02.298577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee51ccb-9ac5-485b-b58d-1cc6241615b3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:02.309189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee51ccb-9ac5-485b-b58d-1cc6241615b3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:02.316392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280d9d4-7be3-429a-999a-64b243bdfc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:02.317123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280d9d4-7be3-429a-999a-64b243bdfc45 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:02.317402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280d9d4-7be3-429a-999a-64b243bdfc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:02.317712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280d9d4-7be3-429a-999a-64b243bdfc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:02.318443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280d9d4-7be3-429a-999a-64b243bdfc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:02.322935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280d9d4-7be3-429a-999a-64b243bdfc45 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:02.352717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 555/1113] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:06:02 2021] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:06:04.684387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f74995-b26e-4326-856a-c456b99e446a None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:04.685123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f74995-b26e-4326-856a-c456b99e446a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:04.685123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f74995-b26e-4326-856a-c456b99e446a None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:04.686909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 559/1114] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:06:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:06:04.694020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276b86a-93d4-4f00-8409-1e962017273a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:04.694625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276b86a-93d4-4f00-8409-1e962017273a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:04.694625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276b86a-93d4-4f00-8409-1e962017273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:04.714675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f276b86a-93d4-4f00-8409-1e962017273a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:06:04.715986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f276b86a-93d4-4f00-8409-1e962017273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:06:04.777003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 556/1115] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:06:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:06:04.804410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f74995-b26e-4326-856a-c456b99e446a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:04.818671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f74995-b26e-4326-856a-c456b99e446a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:04.826166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272831e-e68e-49b5-bb80-be6f4f717311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:04.827044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272831e-e68e-49b5-bb80-be6f4f717311 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:04.827292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272831e-e68e-49b5-bb80-be6f4f717311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:04.828114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272831e-e68e-49b5-bb80-be6f4f717311 admin admin] PATH_INFO: `/v3/domains/40159afa664e4c81b8f3e867a1d09858` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:04.828930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272831e-e68e-49b5-bb80-be6f4f717311 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=40159afa664e4c81b8f3e867a1d09858)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:04.830937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272831e-e68e-49b5-bb80-be6f4f717311 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:04.832551 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 560/1116] 10.222.0.31 () {56 vars in 1204 bytes} [Tue Nov 16 03:06:04 2021] GET /identity/v3/domains/40159afa664e4c81b8f3e867a1d09858 => generated 267 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:04.839276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276b86a-93d4-4f00-8409-1e962017273a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:04.848917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276b86a-93d4-4f00-8409-1e962017273a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:04.854459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808a6cc-bdd7-4c7e-b8a0-3a5d1d621b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:04.855126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808a6cc-bdd7-4c7e-b8a0-3a5d1d621b28 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:04.855427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808a6cc-bdd7-4c7e-b8a0-3a5d1d621b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:04.855679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808a6cc-bdd7-4c7e-b8a0-3a5d1d621b28 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:04.856528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808a6cc-bdd7-4c7e-b8a0-3a5d1d621b28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:04.858514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808a6cc-bdd7-4c7e-b8a0-3a5d1d621b28 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:04.881387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 557/1117] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:06:04 2021] POST /identity/v3/users => generated 311 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:06:07.214320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09dc73-1cf7-4199-9f79-39c50a14ab47 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.214868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09dc73-1cf7-4199-9f79-39c50a14ab47 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.214868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09dc73-1cf7-4199-9f79-39c50a14ab47 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.216704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 561/1118] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:06:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:06:07.222944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f554fe-9062-4034-b204-0fa7ddbdf8c4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.223385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f554fe-9062-4034-b204-0fa7ddbdf8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.223483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f554fe-9062-4034-b204-0fa7ddbdf8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.242660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f3f554fe-9062-4034-b204-0fa7ddbdf8c4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:06:07.243854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f3f554fe-9062-4034-b204-0fa7ddbdf8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:06:07.253194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 558/1119] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:06:07 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:06:07.277817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09dc73-1cf7-4199-9f79-39c50a14ab47 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:07.292377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09dc73-1cf7-4199-9f79-39c50a14ab47 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:07.297767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:07.298484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.298768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.299040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.310339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:06:07.317170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:06:07.318387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 562/1120] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:06:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:06:07.325378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f554fe-9062-4034-b204-0fa7ddbdf8c4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:07.335908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f554fe-9062-4034-b204-0fa7ddbdf8c4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:07.341892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:07.342556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.342830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.343099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.343855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:06:07.344154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:07.345793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:07.354707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 559/1121] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:06:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:07.361529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:07.372153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7037c5-1bc6-4a0d-a529-d2a47b66a2fc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:07.378090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:07.378950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.379232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.379502 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] PATH_INFO: `/v3/users/909c0abc00794eb18e5047bd75b57661` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.395449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] RBAC: Authorizing `identity:get_user(user_id=909c0abc00794eb18e5047bd75b57661)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:07.397700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:07.399416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 563/1122] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:06:07 2021] GET /identity/v3/users/909c0abc00794eb18e5047bd75b57661 => generated 311 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:07.406938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:07.417713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16284d08-8358-4c8a-802b-ebd5515306eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:07.423727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:07.424367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.424646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.424912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.433115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:07.435084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:07.443932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 560/1123] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:06:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:06:07.450745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:07.461149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff623da-c47b-4645-9667-bb6eb0743d19 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:07.467231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356ae73-a722-4444-8cad-7132631dfa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:07.468037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ae73-a722-4444-8cad-7132631dfa03 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.468315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ae73-a722-4444-8cad-7132631dfa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.468588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356ae73-a722-4444-8cad-7132631dfa03 admin admin] PATH_INFO: `/v3/projects/5594fed9412c45a5a47a71b09b423a84` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.469951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ae73-a722-4444-8cad-7132631dfa03 admin admin] RBAC: Authorizing `identity:get_project(project_id=5594fed9412c45a5a47a71b09b423a84)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:07.472018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356ae73-a722-4444-8cad-7132631dfa03 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:07.473742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 564/1124] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:06:07 2021] GET /identity/v3/projects/5594fed9412c45a5a47a71b09b423a84 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:07.481000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:07.490399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917719b-e765-405e-b759-0b74ded556b3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:07.496249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bca40b-d567-4d0f-91c6-4551e99ec494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:07.497052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca40b-d567-4d0f-91c6-4551e99ec494 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:07.497212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca40b-d567-4d0f-91c6-4551e99ec494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:07.497545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bca40b-d567-4d0f-91c6-4551e99ec494 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:07.498377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bca40b-d567-4d0f-91c6-4551e99ec494 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=5594fed9412c45a5a47a71b09b423a84, user.id=909c0abc00794eb18e5047bd75b57661) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:06:07.498676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bca40b-d567-4d0f-91c6-4551e99ec494 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:07.500508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bca40b-d567-4d0f-91c6-4551e99ec494 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:07.506383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 561/1125] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:06:07 2021] GET /identity/v3/role_assignments?user.id=909c0abc00794eb18e5047bd75b57661&scope.project.id=5594fed9412c45a5a47a71b09b423a84&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:09.756488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1c17-8c6e-46da-9465-7c3b3fd9d51f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:09.757089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1c17-8c6e-46da-9465-7c3b3fd9d51f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:09.757089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc1c17-8c6e-46da-9465-7c3b3fd9d51f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:09.759200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 565/1126] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:06:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:06:09.765716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb085c-9620-409f-89d3-b65ecb1efbc9 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:09.766270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb085c-9620-409f-89d3-b65ecb1efbc9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:09.766270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb085c-9620-409f-89d3-b65ecb1efbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:09.787325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-acbb085c-9620-409f-89d3-b65ecb1efbc9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:06:09.788553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-acbb085c-9620-409f-89d3-b65ecb1efbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:06:09.797842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 562/1127] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:06:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:06:09.822409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1c17-8c6e-46da-9465-7c3b3fd9d51f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:09.836427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc1c17-8c6e-46da-9465-7c3b3fd9d51f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:09.841798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:09.842584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:09.842855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:09.843116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:09.853744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:06:09.862629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:06:09.863827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 566/1128] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:06:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:06:09.870943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb085c-9620-409f-89d3-b65ecb1efbc9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:09.880573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb085c-9620-409f-89d3-b65ecb1efbc9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:09.886623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:09.887379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:09.887658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:09.887928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:09.888697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:06:09.889003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:09.890655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:09.899464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 563/1129] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:06:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:09.906547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:09.918739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67003f4-aee0-4540-84a2-38d692d4eb9a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:09.923754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:09.924597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:09.924869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:09.925128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] PATH_INFO: `/v3/users/909c0abc00794eb18e5047bd75b57661` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:09.926396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] RBAC: Authorizing `identity:get_user(user_id=909c0abc00794eb18e5047bd75b57661)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:09.928485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:09.930157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 567/1130] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:06:09 2021] GET /identity/v3/users/909c0abc00794eb18e5047bd75b57661 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:06:09.937150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:09.947436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33497423-9a72-418c-bd3d-8f2b012c5cd0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:09.953298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03309f-e95a-4e39-ac4c-4421518b5efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:09.954189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03309f-e95a-4e39-ac4c-4421518b5efd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:09.954462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03309f-e95a-4e39-ac4c-4421518b5efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:09.954738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03309f-e95a-4e39-ac4c-4421518b5efd admin admin] PATH_INFO: `/v3/projects/5594fed9412c45a5a47a71b09b423a84` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:09.956075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03309f-e95a-4e39-ac4c-4421518b5efd admin admin] RBAC: Authorizing `identity:get_project(project_id=5594fed9412c45a5a47a71b09b423a84)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:09.958221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03309f-e95a-4e39-ac4c-4421518b5efd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:09.959899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 564/1131] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:06:09 2021] GET /identity/v3/projects/5594fed9412c45a5a47a71b09b423a84 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:09.966930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:09.977394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91460f03-c7e6-4fd6-95c3-54e84e368342 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:09.983261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d059c4a-d889-4fd7-8411-ac103b77fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:09.984133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059c4a-d889-4fd7-8411-ac103b77fcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:09.984404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059c4a-d889-4fd7-8411-ac103b77fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:09.984663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d059c4a-d889-4fd7-8411-ac103b77fcc1 admin admin] PATH_INFO: `/v3/projects/5594fed9412c45a5a47a71b09b423a84/users/909c0abc00794eb18e5047bd75b57661/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:09.986861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059c4a-d889-4fd7-8411-ac103b77fcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5594fed9412c45a5a47a71b09b423a84, user_id=909c0abc00794eb18e5047bd75b57661, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:09.989534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d059c4a-d889-4fd7-8411-ac103b77fcc1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:10.004364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 568/1132] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:06:09 2021] PUT /identity/v3/projects/5594fed9412c45a5a47a71b09b423a84/users/909c0abc00794eb18e5047bd75b57661/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:06:12.282568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b908a2-4b27-46f5-94ca-67a082df9293 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.283176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b908a2-4b27-46f5-94ca-67a082df9293 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.283176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b908a2-4b27-46f5-94ca-67a082df9293 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.284883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 565/1133] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:06:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:06:12.292398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054af9b-0091-4f1a-a148-c3c1c6934ed7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.292902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054af9b-0091-4f1a-a148-c3c1c6934ed7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.292998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054af9b-0091-4f1a-a148-c3c1c6934ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.314665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2054af9b-0091-4f1a-a148-c3c1c6934ed7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:06:12.315902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2054af9b-0091-4f1a-a148-c3c1c6934ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:06:12.386454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 569/1134] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:06:12 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:06:12.412266 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b908a2-4b27-46f5-94ca-67a082df9293 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:12.426460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b908a2-4b27-46f5-94ca-67a082df9293 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:12.431660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:12.432587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.432866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.433136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.446196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:06:12.454890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:06:12.456341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 566/1135] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:06:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:06:12.463993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054af9b-0091-4f1a-a148-c3c1c6934ed7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:12.475616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054af9b-0091-4f1a-a148-c3c1c6934ed7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:12.482235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:12.483008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.483318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.483666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.484534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:06:12.484920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:12.486677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:12.497999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 570/1136] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:06:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:12.506870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:12.519942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8be5c-d093-4701-a752-2112d8101571 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:12.525524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:12.526590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.526971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.527252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] PATH_INFO: `/v3/users/909c0abc00794eb18e5047bd75b57661` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.528970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] RBAC: Authorizing `identity:get_user(user_id=909c0abc00794eb18e5047bd75b57661)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:12.531401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:12.533324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 567/1137] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:06:12 2021] GET /identity/v3/users/909c0abc00794eb18e5047bd75b57661 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:12.541088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:12.553119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a5163-5229-469a-b0b5-75d5c5aecd4d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:12.559236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:12.560514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.560793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.561062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.570843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:12.573103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:12.584849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 571/1138] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:06:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:06:12.593594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:12.604561 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587b2df-01fe-4dac-9d56-416e7ff94720 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:12.612451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b19bed-fe39-4e05-a07a-2f0bac7bb434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:12.613469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b19bed-fe39-4e05-a07a-2f0bac7bb434 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.613758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b19bed-fe39-4e05-a07a-2f0bac7bb434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.614042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b19bed-fe39-4e05-a07a-2f0bac7bb434 admin admin] PATH_INFO: `/v3/projects/5594fed9412c45a5a47a71b09b423a84` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.615417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b19bed-fe39-4e05-a07a-2f0bac7bb434 admin admin] RBAC: Authorizing `identity:get_project(project_id=5594fed9412c45a5a47a71b09b423a84)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:12.617820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b19bed-fe39-4e05-a07a-2f0bac7bb434 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:12.619772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 568/1139] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:06:12 2021] GET /identity/v3/projects/5594fed9412c45a5a47a71b09b423a84 => generated 361 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:06:12.629863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:06:12.639863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3f95d-c844-48f2-97fe-d77d21fd3118 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:06:12.645594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b0621-4d1a-495a-acc2-c1917a83ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:06:12.646269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0621-4d1a-495a-acc2-c1917a83ca84 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:06:12.646544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0621-4d1a-495a-acc2-c1917a83ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:06:12.646812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b0621-4d1a-495a-acc2-c1917a83ca84 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:06:12.647687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0621-4d1a-495a-acc2-c1917a83ca84 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=5594fed9412c45a5a47a71b09b423a84, user.id=909c0abc00794eb18e5047bd75b57661) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:06:12.647975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0621-4d1a-495a-acc2-c1917a83ca84 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:06:12.649917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b0621-4d1a-495a-acc2-c1917a83ca84 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:06:12.657159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 572/1140] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:06:12 2021] GET /identity/v3/role_assignments?user.id=909c0abc00794eb18e5047bd75b57661&scope.project.id=5594fed9412c45a5a47a71b09b423a84&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:11.007091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd874ba-d2ea-4d09-ab50-8854f10d1079 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:11.009475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd874ba-d2ea-4d09-ab50-8854f10d1079 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:11.009475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd874ba-d2ea-4d09-ab50-8854f10d1079 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:11.011734 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 569/1141] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:11.020198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8d8b-db44-41f4-8816-b51f5f19f776 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:11.020879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8d8b-db44-41f4-8816-b51f5f19f776 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:11.023818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a8d8b-db44-41f4-8816-b51f5f19f776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:11.045399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-982a8d8b-db44-41f4-8816-b51f5f19f776 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:11.046982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-982a8d8b-db44-41f4-8816-b51f5f19f776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:11.065920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 573/1142] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:11.094935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd874ba-d2ea-4d09-ab50-8854f10d1079 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:11.109911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd874ba-d2ea-4d09-ab50-8854f10d1079 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:11.117004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:11.118080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:11.118416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:11.118679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:11.134270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:11.137093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:11.163590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:11.166025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 570/1143] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:11.179229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a8d8b-db44-41f4-8816-b51f5f19f776 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:11.198007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a8d8b-db44-41f4-8816-b51f5f19f776 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:11.200889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976cc73-4dcc-4929-af38-185fa521224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:11.202042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976cc73-4dcc-4929-af38-185fa521224b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:11.202568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976cc73-4dcc-4929-af38-185fa521224b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:11.203291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976cc73-4dcc-4929-af38-185fa521224b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:11.204548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976cc73-4dcc-4929-af38-185fa521224b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:11.205023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976cc73-4dcc-4929-af38-185fa521224b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:11.207429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976cc73-4dcc-4929-af38-185fa521224b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:11.236601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 574/1144] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:11.241602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:11.258644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fabf8b-4da5-499f-b072-baa1b822e0ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:11.265678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77c821-468c-4fc7-8dfd-2cf41a25dadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:11.266220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c821-468c-4fc7-8dfd-2cf41a25dadb admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:11.266541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c821-468c-4fc7-8dfd-2cf41a25dadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:11.266795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77c821-468c-4fc7-8dfd-2cf41a25dadb admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:11.267661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77c821-468c-4fc7-8dfd-2cf41a25dadb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:11.270020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77c821-468c-4fc7-8dfd-2cf41a25dadb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:11.307627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 571/1145] 10.222.0.31 () {60 vars in 1153 bytes} [Tue Nov 16 03:07:11 2021] POST /identity/v3/users => generated 251 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:07:14.155023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904df7e0-4a31-49cb-921d-dc27c50e91f3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.155610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904df7e0-4a31-49cb-921d-dc27c50e91f3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.155610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904df7e0-4a31-49cb-921d-dc27c50e91f3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.158029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 575/1146] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:14.165928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57f4fe-c4ac-493c-92bc-999524ecbc8a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.166665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57f4fe-c4ac-493c-92bc-999524ecbc8a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.166665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57f4fe-c4ac-493c-92bc-999524ecbc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.191040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2e57f4fe-c4ac-493c-92bc-999524ecbc8a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:14.192584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2e57f4fe-c4ac-493c-92bc-999524ecbc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:14.202602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 572/1147] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:07:14.231700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904df7e0-4a31-49cb-921d-dc27c50e91f3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.248369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904df7e0-4a31-49cb-921d-dc27c50e91f3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.253940 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.255093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.255397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.255677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.268883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:07:14.277830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:07:14.287141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57f4fe-c4ac-493c-92bc-999524ecbc8a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.289528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 576/1148] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:14.298429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57f4fe-c4ac-493c-92bc-999524ecbc8a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.303377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.304059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.304364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.304640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.305501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:14.305830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.307673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.319132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 573/1149] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:14.326373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.339268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db227e93-5205-460d-a3ea-50d33a9b6c10 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.345084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.346209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.346566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.346885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.360379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.362391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.386653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:14.388234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 577/1150] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:14.398262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.419015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb39e85-aaa8-4c76-a672-a6ae585dcb44 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.427312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.428559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.429021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.429548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.430649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:14.431178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.434741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.457776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 574/1151] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:07:14.465625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.478058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20dbeec-1c19-4c8e-b725-0e7e05d8b8af admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.485737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.487275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.487751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.488232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.502124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.506216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.533634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 03:07:14.536246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 578/1152] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:07:14.547292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.564283 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef4124-378a-42f1-859c-32586a72b44d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.571662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.572810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.573363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.574019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.575445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:14.575996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.579579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.614553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 575/1153] 10.222.0.31 () {56 vars in 1164 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:14.619353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.638801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838eaa5-6215-4d83-b73a-a9a5e46264ac admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.643847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.644509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.644789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.645079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.657369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.659692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.673867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 579/1154] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:07:14.680768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.692139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47f85a-0e11-4224-9e34-14c2c279334e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.697651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.698554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.698839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.699146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.711822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.714326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.736350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:14.736350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 576/1155] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:14.744316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.755281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443ab52-005f-4344-b42d-9470941137ce admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.761493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.762402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.762775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.763141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.764008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:14.764388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.766150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.781573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 580/1156] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:14.790627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.804434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee2df2-8bbd-4750-9795-ecebe4e06ca9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.816020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.816996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.817335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.817741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.830172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.832290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.848912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:07:14.850393 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 577/1157] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:14.859349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.872315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f1c6-d397-43b2-8f5d-0aeed466212a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.879565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080307a9-4786-4662-bb20-ee6b1a81a4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.884354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080307a9-4786-4662-bb20-ee6b1a81a4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.884354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080307a9-4786-4662-bb20-ee6b1a81a4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.884354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080307a9-4786-4662-bb20-ee6b1a81a4a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.884354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080307a9-4786-4662-bb20-ee6b1a81a4a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:14.884354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080307a9-4786-4662-bb20-ee6b1a81a4a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.884843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080307a9-4786-4662-bb20-ee6b1a81a4a4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.905523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 581/1158] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:14.914082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:14.928270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae534f9e-a6d5-4e8c-aad4-051aba35d1b4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:14.934014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747a0d0-07db-4786-80af-c22567e03a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:14.934702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a0d0-07db-4786-80af-c22567e03a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:14.934985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a0d0-07db-4786-80af-c22567e03a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:14.935256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747a0d0-07db-4786-80af-c22567e03a7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:14.936142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a0d0-07db-4786-80af-c22567e03a7e admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=4ef0f0386b384a09a87bcce51d172598) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:14.936456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a0d0-07db-4786-80af-c22567e03a7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:14.938549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747a0d0-07db-4786-80af-c22567e03a7e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:14.946568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 578/1159] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:07:14 2021] GET /identity/v3/role_assignments?user.id=4ef0f0386b384a09a87bcce51d172598&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:17.588958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb9d1-fa8d-4506-a60b-4f49e4dedeb8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:17.590755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb9d1-fa8d-4506-a60b-4f49e4dedeb8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:17.590755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fb9d1-fa8d-4506-a60b-4f49e4dedeb8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:17.593457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 582/1160] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:17 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:17.602152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9df9b2-bb09-436b-9d62-49703380e45f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:17.602994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9df9b2-bb09-436b-9d62-49703380e45f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:17.602994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9df9b2-bb09-436b-9d62-49703380e45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:17.631956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0e9df9b2-bb09-436b-9d62-49703380e45f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:17.633344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0e9df9b2-bb09-436b-9d62-49703380e45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:17.653673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 579/1161] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:17.668566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb9d1-fa8d-4506-a60b-4f49e4dedeb8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:17.685618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fb9d1-fa8d-4506-a60b-4f49e4dedeb8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:17.693647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:17.694686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:17.695022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:17.695339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:17.709786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:07:17.717915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:07:17.719576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 583/1162] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:07:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:17.726663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9df9b2-bb09-436b-9d62-49703380e45f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:17.737390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9df9b2-bb09-436b-9d62-49703380e45f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:17.743387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:17.744203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:17.744547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:17.744902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:17.745988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:17.746400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:17.748192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:17.760014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 580/1163] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:07:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:17.768640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:17.784262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b9499b-e0f8-4180-aaaa-bd94bab1943c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:17.791902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:17.793223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:17.793728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:17.794256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:17.815981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:17.819069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:17.845619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:17.847545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 584/1164] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:07:17.854893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:17.866544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654a724-7dee-4194-ae6f-b25632d151c4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:17.873521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:17.874843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:17.875535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:17.876090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:17.877729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:17.878226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:17.881168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:17.904651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 581/1165] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:17.915952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:17.932500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b622f-370c-428e-a468-edd203bc7b3c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:17.943866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:17.945857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:17.946652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:17.947290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:17.962641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:17.966394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:17.985255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 03:07:17.987058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 585/1166] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:17 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:17.994626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:18.007880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c1e19-f804-410d-a3f8-903709996199 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:18.015357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:18.016387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:18.016688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:18.017176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:18.018844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:18.019204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:18.022363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:18.053279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 582/1167] 10.222.0.31 () {56 vars in 1164 bytes} [Tue Nov 16 03:07:17 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:18.062290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:18.072407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6de85-33ba-421e-874f-1b4ac486e287 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:18.079159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:18.081149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:18.081452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:18.081725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:18.094193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:18.096217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:18.118875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:18.121667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 586/1168] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:18.129023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:18.142406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87d66d5-87f6-46a6-b19c-5b89061d0e76 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:18.150806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:18.152516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:18.152910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:18.153199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:18.154229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:18.154651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:18.156963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:18.174834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 583/1169] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:18.184172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:18.197210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae8f6c-3020-451c-bdf0-b60ce2423785 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:18.203229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:18.204303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:18.204566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:18.204845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:18.217787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:18.220032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:18.238542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:07:18.242199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 587/1170] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:07:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:07:18.248353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:18.269231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf813-ce7c-49ee-a691-dd8561c5f19b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:18.277259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4a94-8bea-4c99-9a72-2c2453ec66f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:18.277991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4a94-8bea-4c99-9a72-2c2453ec66f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:18.278265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4a94-8bea-4c99-9a72-2c2453ec66f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:18.278539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4a94-8bea-4c99-9a72-2c2453ec66f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:18.279361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4a94-8bea-4c99-9a72-2c2453ec66f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:18.279670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4a94-8bea-4c99-9a72-2c2453ec66f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:18.281727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4a94-8bea-4c99-9a72-2c2453ec66f6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:18.297036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 584/1171] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:07:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:18.304473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:18.317622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b6bc2-c24a-4475-956e-a9e28f9112f9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:18.323354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abcbe76-4437-43e6-a346-a9f8b16f22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:18.324276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcbe76-4437-43e6-a346-a9f8b16f22db admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:18.324550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcbe76-4437-43e6-a346-a9f8b16f22db admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:18.324821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcbe76-4437-43e6-a346-a9f8b16f22db admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/4ef0f0386b384a09a87bcce51d172598/roles/b984563875e9456592cc79cc4869741d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:18.342879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcbe76-4437-43e6-a346-a9f8b16f22db admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=4ef0f0386b384a09a87bcce51d172598, role_id=b984563875e9456592cc79cc4869741d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:18.345639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abcbe76-4437-43e6-a346-a9f8b16f22db admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:18.361507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 588/1172] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:07:18 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/4ef0f0386b384a09a87bcce51d172598/roles/b984563875e9456592cc79cc4869741d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:07:21.016274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e9da-44af-407e-a17d-55b7abac3f55 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.016912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e9da-44af-407e-a17d-55b7abac3f55 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.016912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac4e9da-44af-407e-a17d-55b7abac3f55 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.019290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 585/1173] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:21.029488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43357c58-dfca-45fd-aa6d-9282ff73a681 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.029488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43357c58-dfca-45fd-aa6d-9282ff73a681 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.029488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43357c58-dfca-45fd-aa6d-9282ff73a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.057687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-43357c58-dfca-45fd-aa6d-9282ff73a681 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:21.059374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-43357c58-dfca-45fd-aa6d-9282ff73a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:21.146036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 589/1174] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:21 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:21.174890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e9da-44af-407e-a17d-55b7abac3f55 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.188042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac4e9da-44af-407e-a17d-55b7abac3f55 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.193091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.193839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.194117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.194386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.206880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:07:21.221132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 16 03:07:21.223669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 586/1175] 10.222.0.31 () {56 vars in 1123 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:21.234203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43357c58-dfca-45fd-aa6d-9282ff73a681 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.244774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43357c58-dfca-45fd-aa6d-9282ff73a681 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.250873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.251704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.252018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.252321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.253165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:21.253552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.255417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.265916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 590/1176] 10.222.0.31 () {56 vars in 1124 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:21.273582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.286668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06b66f-deff-429e-8ee8-4401dae50a6b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.292181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.293023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.293331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.293701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.307069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.309276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.340438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:21.347449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 587/1177] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:07:21.349920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.364255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086fdc-5696-4a87-834a-8ffd9b79dac9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.370000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.370807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.371169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.371499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.372595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:21.373050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.375329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.398091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 591/1178] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:07:21.407363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.422167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9039cea5-7f0e-454d-9d7f-3b0d9c580302 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.428308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.429781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.430230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.430613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.440212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.442451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.457359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 03:07:21.458666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 588/1179] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:07:21.465521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.477159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed1ca1-3146-49a4-b14a-2938992e9908 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.482405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.483085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.483358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.483622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.484476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:21.484776 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.486677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.505193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 592/1180] 10.222.0.31 () {56 vars in 1164 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:21.512433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.524597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac5581-3c07-42e5-9f86-2d053a3dcbf9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.532175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.532829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.533186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.533539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.545250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.547491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.560654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 589/1181] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:07:21.572049 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.589966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c7de1c-a96f-4d36-b123-7a39c299e286 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.597604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.598560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.598941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.599272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.611629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.614002 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.634801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:21.636118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 593/1182] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:07:21.642710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.654541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64afef-6a4d-4d15-a02b-07b5bffc120f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.660939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.661873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.662395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.662845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.664234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:21.664794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.668145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.688491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 590/1183] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:21.695904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.708653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dde46b-843c-4154-a72d-2b2e67841fc1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.715243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.716321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.716535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.716877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.727618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.730671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.751152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:07:21.752509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 594/1184] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:21.762028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.775160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251cbd7-6ef7-402d-9bc1-3075c13d5a82 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.781754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4015de1-8128-4d6c-b96d-2f31b5368a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.782628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015de1-8128-4d6c-b96d-2f31b5368a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.783007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015de1-8128-4d6c-b96d-2f31b5368a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.783361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4015de1-8128-4d6c-b96d-2f31b5368a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.784581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015de1-8128-4d6c-b96d-2f31b5368a6c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:21.784987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015de1-8128-4d6c-b96d-2f31b5368a6c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.788108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4015de1-8128-4d6c-b96d-2f31b5368a6c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.804002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 591/1185] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:21.812008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:21.824399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c2e74-76a8-4b51-978d-696e6c450096 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:21.829996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb18da-2f6d-436d-92d6-f9ae5edcc79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:21.830635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb18da-2f6d-436d-92d6-f9ae5edcc79b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:21.830914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb18da-2f6d-436d-92d6-f9ae5edcc79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:21.831164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb18da-2f6d-436d-92d6-f9ae5edcc79b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:21.832029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb18da-2f6d-436d-92d6-f9ae5edcc79b admin admin] RBAC: Adding query filter params (role.id=b984563875e9456592cc79cc4869741d, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=4ef0f0386b384a09a87bcce51d172598) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:21.832333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb18da-2f6d-436d-92d6-f9ae5edcc79b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:21.834328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb18da-2f6d-436d-92d6-f9ae5edcc79b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:21.842325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 595/1186] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:07:21 2021] GET /identity/v3/role_assignments?user.id=4ef0f0386b384a09a87bcce51d172598&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=b984563875e9456592cc79cc4869741d => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:24.485536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193128b0-36c4-459e-a775-3e8c141f9cb8 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.486308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193128b0-36c4-459e-a775-3e8c141f9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.486308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193128b0-36c4-459e-a775-3e8c141f9cb8 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.488571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 592/1187] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:24.496278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085afef-08ec-410a-8833-ffabd44c96a8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.496849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085afef-08ec-410a-8833-ffabd44c96a8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.496849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085afef-08ec-410a-8833-ffabd44c96a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.524066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8085afef-08ec-410a-8833-ffabd44c96a8 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:24.525770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8085afef-08ec-410a-8833-ffabd44c96a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:24.537012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 596/1188] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:24 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:24.573627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193128b0-36c4-459e-a775-3e8c141f9cb8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:24.595145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193128b0-36c4-459e-a775-3e8c141f9cb8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:24.602707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:24.603871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.604409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.604857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.624548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:07:24.637535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:07:24.639762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 593/1189] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:07:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:24.653470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085afef-08ec-410a-8833-ffabd44c96a8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:24.660601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085afef-08ec-410a-8833-ffabd44c96a8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:24.667278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:24.668106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.668439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.668734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.669612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:24.669985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:24.672044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:24.684227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 597/1190] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:07:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:24.694112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:24.714203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed7afc-e8f7-458d-a4b5-5291d82e3bbb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:24.722677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:24.723507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.723785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.724059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.740913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:24.743455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:24.768457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:24.769933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 594/1191] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:24.777802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:24.789643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1a6f8-25c3-4468-af5e-b57a2b401939 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:24.796400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:24.797561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.798041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.798447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.799521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:24.799838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:24.802436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:24.817666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 598/1192] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:07:24.830560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:24.844968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b644be-1e91-4a7b-9a5b-c145d001eae3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:24.850653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:24.851507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.851782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.852052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.860526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:24.862691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:24.877773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 03:07:24.879064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 595/1193] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:24 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:24.890594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:24.906031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a70a2-d99a-4c9f-b2c3-238f2a73ba94 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:24.913322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:24.914084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.914425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.914731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.916022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:24.916342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:24.919669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:24.948322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 599/1194] 10.222.0.31 () {56 vars in 1164 bytes} [Tue Nov 16 03:07:24 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:24.956736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:24.968932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab689889-3d6f-43f3-94c6-1765433bb1d1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:24.975363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:24.976500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:24.976946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:24.977328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:24.988298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:24.990189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:25.003519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 596/1195] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:07:24 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:07:25.014284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:25.025135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb196-8647-4dc1-a6f7-31a791ce8bd8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:25.031348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:25.032320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:25.032612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:25.032930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:25.054832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:25.058484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:25.091051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:25.092880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 600/1196] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:25.100971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:25.111738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63eaf7-1a38-4601-a8cf-f5fb6c9b7374 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:25.118271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:25.119783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:25.120231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:25.120818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:25.122314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:25.122730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:25.125806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:25.142846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 597/1197] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:25.149970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:25.165061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb259e4-e1d3-4e1b-b92f-7e3a1582dbd1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:25.170587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:25.171432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:25.171713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:25.171980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:25.180484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:25.183971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:25.200377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:07:25.201687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 601/1198] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:07:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 16 03:07:25.208821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:25.219023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e42b2-4452-49fe-9cf8-782a9bccf1a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:25.223824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b294f-1a33-48cc-bd7b-679bc941cb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:25.224480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b294f-1a33-48cc-bd7b-679bc941cb83 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:25.224757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b294f-1a33-48cc-bd7b-679bc941cb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:25.225034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b294f-1a33-48cc-bd7b-679bc941cb83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:25.225862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b294f-1a33-48cc-bd7b-679bc941cb83 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:25.226169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b294f-1a33-48cc-bd7b-679bc941cb83 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:25.228011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b294f-1a33-48cc-bd7b-679bc941cb83 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:25.253939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 598/1199] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:07:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:07:25.255324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:25.268632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0132c-d35f-4fdd-99ba-e5ff0619cfb3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:25.274191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bb4a7-060a-486c-b736-f3ee5a03c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:25.274931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb4a7-060a-486c-b736-f3ee5a03c9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:25.275196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb4a7-060a-486c-b736-f3ee5a03c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:25.275514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bb4a7-060a-486c-b736-f3ee5a03c9d2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:25.276511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb4a7-060a-486c-b736-f3ee5a03c9d2 admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=4ef0f0386b384a09a87bcce51d172598) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:25.276857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb4a7-060a-486c-b736-f3ee5a03c9d2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:25.278964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bb4a7-060a-486c-b736-f3ee5a03c9d2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:25.287719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 602/1200] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:07:25 2021] GET /identity/v3/role_assignments?user.id=4ef0f0386b384a09a87bcce51d172598&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:27.850834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1275b-28d9-43c4-bacd-7235518e2535 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:27.851379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1275b-28d9-43c4-bacd-7235518e2535 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:27.851379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1275b-28d9-43c4-bacd-7235518e2535 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:27.853179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 599/1201] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:07:27.860052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679b1ab-2978-4dfe-9b61-d9ea0bb1b28b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:27.860705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679b1ab-2978-4dfe-9b61-d9ea0bb1b28b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:27.860705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679b1ab-2978-4dfe-9b61-d9ea0bb1b28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:27.880326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9679b1ab-2978-4dfe-9b61-d9ea0bb1b28b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:27.881728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9679b1ab-2978-4dfe-9b61-d9ea0bb1b28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:27.891795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 603/1202] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:27.924638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1275b-28d9-43c4-bacd-7235518e2535 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:27.938846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1275b-28d9-43c4-bacd-7235518e2535 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:27.944310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:27.945133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:27.945409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:27.945713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:27.961673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:07:27.978169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:07:27.980884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 600/1203] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:07:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:27.994445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679b1ab-2978-4dfe-9b61-d9ea0bb1b28b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.006406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679b1ab-2978-4dfe-9b61-d9ea0bb1b28b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.011695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.012382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.012657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.012921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.013722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:28.014023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.015634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.025251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 604/1204] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:07:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:28.033209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.049700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13340fcc-1222-4836-9e4a-b1ab9fe4f14f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.055459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.056464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.056673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.059168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.072724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.075331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.095352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:28.096525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 601/1205] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:28.104654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.114335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cdf34-692c-4461-b2af-ccab25de58f5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.119035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.119770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.120053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.120320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.121263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:28.121581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.123177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.137490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 605/1206] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:28.144981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.156089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6fb53-feb3-4801-a028-18a75f095961 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.161807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.162621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.163076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.163243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.174481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.176550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.193863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 03:07:28.195344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 602/1207] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:28.203534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.214031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41836948-b522-49a9-9c2f-17b24fdccc1e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.219518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.220196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.220466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.220729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.221609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:28.221907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.223785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.242503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 606/1208] 10.222.0.31 () {56 vars in 1164 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:07:28.253512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.264845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadeced6-8115-4e41-887a-fb78c0c23888 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.270309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.271078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.271365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.271617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.282677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.284532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.303656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:28.304917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 603/1209] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:28.311776 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.322154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542faf07-73a8-45cf-8508-3ce2d94e62a1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.328090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.328786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.329070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.329343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.330154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:28.330517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.332628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.348107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 607/1210] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:28.355995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.367304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fe760-b26d-4f12-988b-ac1e6792eb20 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.372480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.373316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.373634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.373911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.382696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.385008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.401373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:07:28.403170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 604/1211] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:28.411113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.424563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717a9b8-3cfd-432f-987a-9eab533586b2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.430892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac50e23-b957-4f17-8d32-2cfebb6fb97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.431752 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac50e23-b957-4f17-8d32-2cfebb6fb97a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.432253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac50e23-b957-4f17-8d32-2cfebb6fb97a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.432716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac50e23-b957-4f17-8d32-2cfebb6fb97a admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.434008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac50e23-b957-4f17-8d32-2cfebb6fb97a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:28.434435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac50e23-b957-4f17-8d32-2cfebb6fb97a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.436596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac50e23-b957-4f17-8d32-2cfebb6fb97a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.453867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 608/1212] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:07:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:28.461375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:28.474858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc6eda-0618-4362-bef8-bf6b669f0fb7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:28.480316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8a644-3f98-412d-a281-da28507e3628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:28.481238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a644-3f98-412d-a281-da28507e3628 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:28.481564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a644-3f98-412d-a281-da28507e3628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:28.481842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8a644-3f98-412d-a281-da28507e3628 admin admin] PATH_INFO: `/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/4ef0f0386b384a09a87bcce51d172598/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:28.484184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8a644-3f98-412d-a281-da28507e3628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c8d5a234af4eadae2610fa7acd3727, user_id=4ef0f0386b384a09a87bcce51d172598, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:28.487400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8a644-3f98-412d-a281-da28507e3628 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:28.505642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 605/1213] 10.222.0.31 () {58 vars in 1460 bytes} [Tue Nov 16 03:07:28 2021] PUT /identity/v3/projects/b9c8d5a234af4eadae2610fa7acd3727/users/4ef0f0386b384a09a87bcce51d172598/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:07:30.940289 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca92a7-a83e-4d27-824d-c859f8f24993 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:30.940861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca92a7-a83e-4d27-824d-c859f8f24993 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:30.940861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca92a7-a83e-4d27-824d-c859f8f24993 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:30.942642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 609/1214] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:30.948840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2b07-cbb4-4caa-966d-46f7833cbe21 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:30.949333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2b07-cbb4-4caa-966d-46f7833cbe21 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:30.949333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a2b07-cbb4-4caa-966d-46f7833cbe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:30.967812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-660a2b07-cbb4-4caa-966d-46f7833cbe21 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:30.969016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-660a2b07-cbb4-4caa-966d-46f7833cbe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:31.032678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 606/1215] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:31.057455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca92a7-a83e-4d27-824d-c859f8f24993 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.071867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca92a7-a83e-4d27-824d-c859f8f24993 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.077890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.078615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.078887 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.079150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.092029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 16 03:07:31.099065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 16 03:07:31.100358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 610/1216] 10.222.0.31 () {56 vars in 1117 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:31.109920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a2b07-cbb4-4caa-966d-46f7833cbe21 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.119726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a2b07-cbb4-4caa-966d-46f7833cbe21 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.125815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.126519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.126792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.127032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.127845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:31.128146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.129869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.140043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 607/1217] 10.222.0.31 () {56 vars in 1120 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:31.146977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.158622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424dcd1-eb8c-4e32-8462-33500739d280 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.165125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.165976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.166254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.166846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.178847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.180732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.199997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:31.201318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 611/1218] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:31.208223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.219074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1f6c7-0313-452d-8a56-c029b885d70d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.225209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.225930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.226205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.226469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.227216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:31.227517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.229238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.242961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 608/1219] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:31.249799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.260763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e9583-1687-475e-94ce-a598e0c8267a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.266788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.267600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.267876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.268148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.277373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.279472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.297294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 16 03:07:31.298537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 612/1220] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:31.305400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.315563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539ece-8f3f-4932-bbe8-e5d69e96d77b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.320522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.321188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.321493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.321768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.322800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:31.323440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.325293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.343740 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 609/1221] 10.222.0.31 () {56 vars in 1164 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:31.350619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.361255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294ba11-1c46-46da-aefb-0483329413af admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.367211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.367856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.368131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.368397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.376835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.378603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.387673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 613/1222] 10.222.0.31 () {58 vars in 1324 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:07:31.394619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.405652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f763aa0-8625-4500-84f5-84c68d2fa2bf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.411128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.411923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.412198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.412468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.423761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.425665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.443663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 16 03:07:31.444854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 610/1223] 10.222.0.31 () {56 vars in 1129 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:31.452301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.462165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e3e9e-fe2a-4a03-84f9-b86d6cf82e3c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.468253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.468909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.469184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.469455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.470206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:31.470503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.472116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.484226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 614/1224] 10.222.0.31 () {56 vars in 1130 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:31.490883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.501413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31274dcc-b5e6-48de-92a5-5cc09b7c4a35 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.507306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.508096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.508375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.508644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.515901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.517911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.531047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING keystone.server.flask.application [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 16 03:07:31.532216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 611/1225] 10.222.0.31 () {56 vars in 1132 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:31.539795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.552434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb10dd-d376-48f8-ba77-afc0945aae05 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.558844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9db1-13f3-42fa-9193-855bf1b2b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.559629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9db1-13f3-42fa-9193-855bf1b2b90b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.559855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9db1-13f3-42fa-9193-855bf1b2b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.560215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9db1-13f3-42fa-9193-855bf1b2b90b admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.561168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9db1-13f3-42fa-9193-855bf1b2b90b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:31.561557 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9db1-13f3-42fa-9193-855bf1b2b90b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.563415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9db1-13f3-42fa-9193-855bf1b2b90b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.578909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 615/1226] 10.222.0.31 () {56 vars in 1169 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:31.585861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:31.597636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76266ec6-aa19-405b-b140-df87dda69629 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:31.603164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79edd54-48b5-4ad7-8a77-ff442739867a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:31.603838 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79edd54-48b5-4ad7-8a77-ff442739867a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:31.604115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79edd54-48b5-4ad7-8a77-ff442739867a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:31.604378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79edd54-48b5-4ad7-8a77-ff442739867a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:31.605327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79edd54-48b5-4ad7-8a77-ff442739867a admin admin] RBAC: Adding query filter params (role.id=5308483f37b74ac6aa272e02c97d6324, scope.project.id=b9c8d5a234af4eadae2610fa7acd3727, user.id=4ef0f0386b384a09a87bcce51d172598) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:31.605661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79edd54-48b5-4ad7-8a77-ff442739867a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:31.607516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79edd54-48b5-4ad7-8a77-ff442739867a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:31.614052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 612/1227] 10.222.0.31 () {56 vars in 1395 bytes} [Tue Nov 16 03:07:31 2021] GET /identity/v3/role_assignments?user.id=4ef0f0386b384a09a87bcce51d172598&scope.project.id=b9c8d5a234af4eadae2610fa7acd3727&role.id=5308483f37b74ac6aa272e02c97d6324 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:33.921209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d22bd-d671-4bfc-83ec-b39c0d4592f3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:33.921810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d22bd-d671-4bfc-83ec-b39c0d4592f3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:33.921810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1d22bd-d671-4bfc-83ec-b39c0d4592f3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:33.923558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 616/1228] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:33.929982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32054ef-e91f-48a3-bf83-3a33e42e6d9d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:33.930385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32054ef-e91f-48a3-bf83-3a33e42e6d9d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:33.930524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32054ef-e91f-48a3-bf83-3a33e42e6d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:33.950196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f32054ef-e91f-48a3-bf83-3a33e42e6d9d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:33.951382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f32054ef-e91f-48a3-bf83-3a33e42e6d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:33.960610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 613/1229] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:33.985494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d22bd-d671-4bfc-83ec-b39c0d4592f3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:34.001263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1d22bd-d671-4bfc-83ec-b39c0d4592f3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:34.006754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:34.007639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:34.007945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:34.008218 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:34.009051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:34.011078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:34.026085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 16 03:07:34.027734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 617/1230] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:07:33 2021] GET /identity/v3/services/placement => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:34.035713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32054ef-e91f-48a3-bf83-3a33e42e6d9d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:34.045611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32054ef-e91f-48a3-bf83-3a33e42e6d9d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:34.051248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ccea1-c535-4a92-96b1-2f1dee350e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:34.051915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccea1-c535-4a92-96b1-2f1dee350e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:34.052194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccea1-c535-4a92-96b1-2f1dee350e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:34.052460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ccea1-c535-4a92-96b1-2f1dee350e4d admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:34.053184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ccea1-c535-4a92-96b1-2f1dee350e4d admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:34.053515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ccea1-c535-4a92-96b1-2f1dee350e4d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:34.055125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ccea1-c535-4a92-96b1-2f1dee350e4d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:34.061023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 614/1231] 10.222.0.31 () {56 vars in 1137 bytes} [Tue Nov 16 03:07:34 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:34.067748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:34.078992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66390258-6f35-4595-af12-3c47d144aad6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:34.084299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0c823-974e-4d31-b6d4-169b43cd5957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:34.085011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c823-974e-4d31-b6d4-169b43cd5957 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:34.085317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c823-974e-4d31-b6d4-169b43cd5957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:34.085687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0c823-974e-4d31-b6d4-169b43cd5957 admin admin] PATH_INFO: `/v3/services` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:34.086469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0c823-974e-4d31-b6d4-169b43cd5957 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:34.086808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0c823-974e-4d31-b6d4-169b43cd5957 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:34.088620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0c823-974e-4d31-b6d4-169b43cd5957 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:34.093546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 618/1232] 10.222.0.31 () {56 vars in 1137 bytes} [Tue Nov 16 03:07:34 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:36.457861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841982f-de60-4a79-8cfe-8f6792c6a751 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:36.458434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841982f-de60-4a79-8cfe-8f6792c6a751 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:36.458434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841982f-de60-4a79-8cfe-8f6792c6a751 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:36.460190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 615/1233] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:36.466684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365ab1-96b3-49e8-a86e-5d99f256a424 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:36.467130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365ab1-96b3-49e8-a86e-5d99f256a424 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:36.467223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36365ab1-96b3-49e8-a86e-5d99f256a424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:36.489033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-36365ab1-96b3-49e8-a86e-5d99f256a424 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:36.490340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-36365ab1-96b3-49e8-a86e-5d99f256a424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:36.498870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 619/1234] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:36.522749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841982f-de60-4a79-8cfe-8f6792c6a751 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:36.537246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841982f-de60-4a79-8cfe-8f6792c6a751 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:36.542818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9c165-f04b-417c-86d5-f6711860f4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:36.543476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c165-f04b-417c-86d5-f6711860f4d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:36.543753 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c165-f04b-417c-86d5-f6711860f4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:36.544026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9c165-f04b-417c-86d5-f6711860f4d2 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:36.544761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c165-f04b-417c-86d5-f6711860f4d2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:36.546401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9c165-f04b-417c-86d5-f6711860f4d2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:36.561004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 616/1235] 10.222.0.31 () {60 vars in 1162 bytes} [Tue Nov 16 03:07:36 2021] POST /identity/v3/services => generated 246 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:07:38.875318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434e36-b5f6-4519-9837-208b20bd08e9 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:38.875969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434e36-b5f6-4519-9837-208b20bd08e9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:38.875969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39434e36-b5f6-4519-9837-208b20bd08e9 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:38.877709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 620/1236] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:38.884339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8632-5646-4fe3-beae-f3178989513a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:38.884912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8632-5646-4fe3-beae-f3178989513a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:38.884912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f8632-5646-4fe3-beae-f3178989513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:38.905096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1e0f8632-5646-4fe3-beae-f3178989513a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:38.906337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1e0f8632-5646-4fe3-beae-f3178989513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:38.926976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 617/1237] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:38 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:38.958613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434e36-b5f6-4519-9837-208b20bd08e9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:38.972695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39434e36-b5f6-4519-9837-208b20bd08e9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:38.977565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:38.978381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:38.978708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:38.978973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:38.979614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:38.981235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:38.994555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 16 03:07:38.996708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 621/1238] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:07:38 2021] GET /identity/v3/services/placement => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:39.006717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8632-5646-4fe3-beae-f3178989513a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:39.020884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f8632-5646-4fe3-beae-f3178989513a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:39.026044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:39.026760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:39.027218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:39.027339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:39.028029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:39.028347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:39.030001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:39.036706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 618/1239] 10.222.0.31 () {56 vars in 1137 bytes} [Tue Nov 16 03:07:39 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:39.045618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:39.060706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972eb65-9091-43fb-b591-7b62c192265a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:39.066881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e482-a04c-4a47-ae83-87d372d31e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:39.067714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e482-a04c-4a47-ae83-87d372d31e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:39.068139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e482-a04c-4a47-ae83-87d372d31e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:39.068552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e482-a04c-4a47-ae83-87d372d31e92 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:39.069494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11e482-a04c-4a47-ae83-87d372d31e92 admin admin] RBAC: Adding query filter params (interface=public, service_id=1842f97f6c774babb8e9cf38283eba1b, region_id=RegionOne) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:39.069933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11e482-a04c-4a47-ae83-87d372d31e92 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:39.071719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11e482-a04c-4a47-ae83-87d372d31e92 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:39.085680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 622/1240] 10.222.0.31 () {56 vars in 1272 bytes} [Tue Nov 16 03:07:39 2021] GET /identity/v3/endpoints?service_id=1842f97f6c774babb8e9cf38283eba1b&interface=public®ion_id=RegionOne => generated 194 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:39.089385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:39.100973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb98e-b6b8-4ee0-a742-190431d644c1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:39.106414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d36866-3e47-435b-b199-d0abb201250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:39.107099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36866-3e47-435b-b199-d0abb201250e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:39.107372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36866-3e47-435b-b199-d0abb201250e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:39.107639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d36866-3e47-435b-b199-d0abb201250e admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:39.108330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d36866-3e47-435b-b199-d0abb201250e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:39.109955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d36866-3e47-435b-b199-d0abb201250e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:39.117093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 619/1241] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:07:39 2021] GET /identity/v3/services => generated 2191 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:07:41.426656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d609e5-35c0-4758-b2e2-a042cfd6b4ce None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:41.427263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d609e5-35c0-4758-b2e2-a042cfd6b4ce None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:41.427263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d609e5-35c0-4758-b2e2-a042cfd6b4ce None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:41.428981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 623/1242] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:07:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:07:41.435932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d1ab-ef71-42bb-9c83-783ca4047586 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:41.436464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d1ab-ef71-42bb-9c83-783ca4047586 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:41.436464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1460d1ab-ef71-42bb-9c83-783ca4047586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:41.456298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1460d1ab-ef71-42bb-9c83-783ca4047586 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:07:41.457568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1460d1ab-ef71-42bb-9c83-783ca4047586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:07:41.467337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 620/1243] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:07:41 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:07:41.493935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d609e5-35c0-4758-b2e2-a042cfd6b4ce None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:41.507124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d609e5-35c0-4758-b2e2-a042cfd6b4ce None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:41.512277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:41.513125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:41.513403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:41.513698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:41.514372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:41.515967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:41.527834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING keystone.server.flask.application [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 16 03:07:41.529062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 624/1244] 10.222.0.31 () {56 vars in 1138 bytes} [Tue Nov 16 03:07:41 2021] GET /identity/v3/services/placement => generated 90 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 16 03:07:41.536704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460d1ab-ef71-42bb-9c83-783ca4047586 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:41.546666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1460d1ab-ef71-42bb-9c83-783ca4047586 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:41.552307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba4f1a-b881-4a1a-93ea-1bb8b87be4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:41.552991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba4f1a-b881-4a1a-93ea-1bb8b87be4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:41.553269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba4f1a-b881-4a1a-93ea-1bb8b87be4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:41.553706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba4f1a-b881-4a1a-93ea-1bb8b87be4e0 admin admin] PATH_INFO: `/v3/services` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:41.554847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba4f1a-b881-4a1a-93ea-1bb8b87be4e0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:07:41.555157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba4f1a-b881-4a1a-93ea-1bb8b87be4e0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:41.556871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba4f1a-b881-4a1a-93ea-1bb8b87be4e0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:41.563436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 621/1245] 10.222.0.31 () {56 vars in 1137 bytes} [Tue Nov 16 03:07:41 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:07:41.572843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:07:41.584946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf984ee-96e1-4ae3-b355-bc58738ade8f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:07:41.591362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a1c4e-0d69-467c-9406-195c2b2ed30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:07:41.592047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1c4e-0d69-467c-9406-195c2b2ed30c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:07:41.592324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1c4e-0d69-467c-9406-195c2b2ed30c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:07:41.592591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1c4e-0d69-467c-9406-195c2b2ed30c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:07:41.593367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a1c4e-0d69-467c-9406-195c2b2ed30c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:07:41.595099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a1c4e-0d69-467c-9406-195c2b2ed30c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:07:41.619918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 625/1246] 10.222.0.31 () {60 vars in 1165 bytes} [Tue Nov 16 03:07:41 2021] POST /identity/v3/endpoints => generated 331 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:08:49.540371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01226954-52b5-4b7e-aa06-f52a34d2f8dc None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:49.540878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01226954-52b5-4b7e-aa06-f52a34d2f8dc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:49.540973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01226954-52b5-4b7e-aa06-f52a34d2f8dc None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:49.542823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 622/1247] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:08:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:08:49.549511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731bff-5faf-486f-be3d-6a7571d71a30 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:49.549967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731bff-5faf-486f-be3d-6a7571d71a30 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:49.550065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71731bff-5faf-486f-be3d-6a7571d71a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:49.738352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-71731bff-5faf-486f-be3d-6a7571d71a30 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:08:49.749892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-71731bff-5faf-486f-be3d-6a7571d71a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:49.891830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 626/1248] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:08:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:08:49.916886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01226954-52b5-4b7e-aa06-f52a34d2f8dc None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:08:49.920174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-01226954-52b5-4b7e-aa06-f52a34d2f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:50.094914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01226954-52b5-4b7e-aa06-f52a34d2f8dc None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:08:50.199339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9da6c-c5d5-48f6-b48d-a30cf9612342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:08:50.200118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9da6c-c5d5-48f6-b48d-a30cf9612342 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:50.200458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9da6c-c5d5-48f6-b48d-a30cf9612342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:50.200845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9da6c-c5d5-48f6-b48d-a30cf9612342 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:50.201774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9da6c-c5d5-48f6-b48d-a30cf9612342 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:08:50.203735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9da6c-c5d5-48f6-b48d-a30cf9612342 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:08:50.227635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 623/1249] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:08:49 2021] GET /identity/v3/projects => generated 2553 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:08:52.687736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12993-3600-4a1c-b5cb-3cc51e92fa3c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:52.688294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12993-3600-4a1c-b5cb-3cc51e92fa3c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:52.688294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf12993-3600-4a1c-b5cb-3cc51e92fa3c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:52.690107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 627/1250] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:08:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:08:52.697232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9dd0-8f7e-4fc9-a484-68a866b71ea7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:52.697839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9dd0-8f7e-4fc9-a484-68a866b71ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:52.697839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac9dd0-8f7e-4fc9-a484-68a866b71ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:52.775748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ecac9dd0-8f7e-4fc9-a484-68a866b71ea7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:08:52.777079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ecac9dd0-8f7e-4fc9-a484-68a866b71ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:52.891323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 624/1251] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:08:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:08:52.945148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e31c3-7410-4003-ae32-d4dc7c64f685 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:52.945552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e31c3-7410-4003-ae32-d4dc7c64f685 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:52.946186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e31c3-7410-4003-ae32-d4dc7c64f685 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:52.948082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 628/1252] 10.222.0.31 () {54 vars in 964 bytes} [Tue Nov 16 03:08:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:08:52.954898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b680-f845-4916-9d02-6f81a69c9745 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:52.955186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b680-f845-4916-9d02-6f81a69c9745 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:52.955630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005b680-f845-4916-9d02-6f81a69c9745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:53.043073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5005b680-f845-4916-9d02-6f81a69c9745 None None] MFA Rules not processed for user `6d09511f0bb7411f9f8c06f49d3a5810`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:08:53.044258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5005b680-f845-4916-9d02-6f81a69c9745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:53.134060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 625/1253] 10.222.0.31 () {58 vars in 1061 bytes} [Tue Nov 16 03:08:52 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:08:53.142928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e31c3-7410-4003-ae32-d4dc7c64f685 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:08:53.144543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6f6e31c3-7410-4003-ae32-d4dc7c64f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:53.267097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e31c3-7410-4003-ae32-d4dc7c64f685 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:08:53.348156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336252e-20b0-486d-bb80-aadb6ad3a34f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:08:53.348732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336252e-20b0-486d-bb80-aadb6ad3a34f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:53.349015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336252e-20b0-486d-bb80-aadb6ad3a34f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:53.349280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336252e-20b0-486d-bb80-aadb6ad3a34f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:53.351003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2336252e-20b0-486d-bb80-aadb6ad3a34f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:53.472380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336252e-20b0-486d-bb80-aadb6ad3a34f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:08:53.473885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336252e-20b0-486d-bb80-aadb6ad3a34f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:08:53.496960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 629/1254] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:08:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:08:56.070688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16021-e387-4953-bf01-4f37d3d02f53 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:56.071247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16021-e387-4953-bf01-4f37d3d02f53 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:56.071247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16021-e387-4953-bf01-4f37d3d02f53 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:56.073006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 626/1255] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:08:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:08:56.079718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d2af5-1bd8-4492-9cc2-41db1c0e445c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:56.080297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d2af5-1bd8-4492-9cc2-41db1c0e445c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:56.080297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d2af5-1bd8-4492-9cc2-41db1c0e445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:56.163749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6f8d2af5-1bd8-4492-9cc2-41db1c0e445c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:08:56.165150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6f8d2af5-1bd8-4492-9cc2-41db1c0e445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:56.262654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 630/1256] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:08:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:08:56.319812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469dbe7-8b6f-496c-87f5-a8dfa029d0d4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:56.320233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469dbe7-8b6f-496c-87f5-a8dfa029d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:56.320728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469dbe7-8b6f-496c-87f5-a8dfa029d0d4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:56.323439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 627/1257] 10.222.0.31 () {54 vars in 964 bytes} [Tue Nov 16 03:08:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:08:56.330201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dea29-8b2b-4f2c-8115-8f79e22596ac None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:56.330367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dea29-8b2b-4f2c-8115-8f79e22596ac None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:56.330662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dea29-8b2b-4f2c-8115-8f79e22596ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:56.405073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-947dea29-8b2b-4f2c-8115-8f79e22596ac None None] MFA Rules not processed for user `6d09511f0bb7411f9f8c06f49d3a5810`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:08:56.406318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-947dea29-8b2b-4f2c-8115-8f79e22596ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:56.489315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 631/1258] 10.222.0.31 () {58 vars in 1061 bytes} [Tue Nov 16 03:08:56 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:08:56.500421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469dbe7-8b6f-496c-87f5-a8dfa029d0d4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:08:56.501995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7469dbe7-8b6f-496c-87f5-a8dfa029d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:56.617559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469dbe7-8b6f-496c-87f5-a8dfa029d0d4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:08:56.695304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d51963-6694-4aca-9609-daec02553e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:08:56.696201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51963-6694-4aca-9609-daec02553e4e service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:56.696700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51963-6694-4aca-9609-daec02553e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:56.696984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d51963-6694-4aca-9609-daec02553e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:56.698694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-16d51963-6694-4aca-9609-daec02553e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:56.809081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d51963-6694-4aca-9609-daec02553e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:08:56.810584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d51963-6694-4aca-9609-daec02553e4e service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:08:56.829714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 628/1259] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:08:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:08:59.676894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77437b1-3658-4799-931f-4b66adf73dd5 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:59.677526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77437b1-3658-4799-931f-4b66adf73dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:59.677757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77437b1-3658-4799-931f-4b66adf73dd5 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:59.679566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 632/1260] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:08:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:08:59.686210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:08:59.686677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:08:59.686677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:08:59.756043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:08:59.757275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:08:59.857319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 629/1261] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:08:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:08:59.893742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77437b1-3658-4799-931f-4b66adf73dd5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:08:59.895268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c77437b1-3658-4799-931f-4b66adf73dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:00.033412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77437b1-3658-4799-931f-4b66adf73dd5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:00.127618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1d121-e8de-433e-a4c2-3c0f73b551fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:00.128474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1d121-e8de-433e-a4c2-3c0f73b551fe admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:00.128748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1d121-e8de-433e-a4c2-3c0f73b551fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:00.129006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1d121-e8de-433e-a4c2-3c0f73b551fe admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:00.139145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1d121-e8de-433e-a4c2-3c0f73b551fe admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:00.141217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1d121-e8de-433e-a4c2-3c0f73b551fe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:00.142993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 633/1262] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:08:59 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:09:00.156220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:00.157502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:00.256306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94f789-7308-4d82-ad7e-8bd9321ddf2a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:00.333069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffae43-c862-4e60-a0ce-48f91692abad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:00.333655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffae43-c862-4e60-a0ce-48f91692abad service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:00.333937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffae43-c862-4e60-a0ce-48f91692abad service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:00.334208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffae43-c862-4e60-a0ce-48f91692abad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:00.335851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f8ffae43-c862-4e60-a0ce-48f91692abad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:00.455075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffae43-c862-4e60-a0ce-48f91692abad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:00.456552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffae43-c862-4e60-a0ce-48f91692abad service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:00.476173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 630/1263] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:03.354861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21482-50b0-4aa4-a687-4cf25d7c6272 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:03.355463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21482-50b0-4aa4-a687-4cf25d7c6272 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:03.355463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21482-50b0-4aa4-a687-4cf25d7c6272 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:03.357233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 634/1264] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:03.363672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:03.364145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:03.364234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:03.438204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:03.439440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:03.542069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 631/1265] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:03.578113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f21482-50b0-4aa4-a687-4cf25d7c6272 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:03.579662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b0f21482-50b0-4aa4-a687-4cf25d7c6272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:03.709033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f21482-50b0-4aa4-a687-4cf25d7c6272 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:03.803581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdc5bd-064f-458f-83ba-267edfa85455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:03.804433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdc5bd-064f-458f-83ba-267edfa85455 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:03.804725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdc5bd-064f-458f-83ba-267edfa85455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:03.804979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdc5bd-064f-458f-83ba-267edfa85455 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:03.816182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdc5bd-064f-458f-83ba-267edfa85455 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:03.818698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bdc5bd-064f-458f-83ba-267edfa85455 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:03.820671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 635/1266] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:09:03 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:09:03.834411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:03.835665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:03.929039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed119e36-0d10-43f1-874a-2ec017b5bc3a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:04.025062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8b8f9-3885-495e-bbe2-85d40066d2c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:04.025774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8b8f9-3885-495e-bbe2-85d40066d2c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:04.026051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8b8f9-3885-495e-bbe2-85d40066d2c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:04.026321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8b8f9-3885-495e-bbe2-85d40066d2c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:04.028125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e9b8b8f9-3885-495e-bbe2-85d40066d2c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:04.157973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8b8f9-3885-495e-bbe2-85d40066d2c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:04.159472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8b8f9-3885-495e-bbe2-85d40066d2c9 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:04.181056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 632/1267] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:07.219741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771bc9-9876-4809-8b3e-5e2225271dcd None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:07.220309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771bc9-9876-4809-8b3e-5e2225271dcd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:07.220503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771bc9-9876-4809-8b3e-5e2225271dcd None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:07.223281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 636/1268] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:07.231041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02e39-6e63-44ef-ac09-f708ee1a3ce5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:07.231663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02e39-6e63-44ef-ac09-f708ee1a3ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:07.231663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc02e39-6e63-44ef-ac09-f708ee1a3ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:07.309606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8bc02e39-6e63-44ef-ac09-f708ee1a3ce5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:07.310855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8bc02e39-6e63-44ef-ac09-f708ee1a3ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:07.424408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 633/1269] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:07.463008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771bc9-9876-4809-8b3e-5e2225271dcd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:07.464636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b0771bc9-9876-4809-8b3e-5e2225271dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:07.583292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771bc9-9876-4809-8b3e-5e2225271dcd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:07.668686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87527032-cab8-484c-b1c8-aeceba2b982c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:07.669345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87527032-cab8-484c-b1c8-aeceba2b982c service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:07.669652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87527032-cab8-484c-b1c8-aeceba2b982c service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:07.669924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87527032-cab8-484c-b1c8-aeceba2b982c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:07.671623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-87527032-cab8-484c-b1c8-aeceba2b982c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:07.798312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87527032-cab8-484c-b1c8-aeceba2b982c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:07.799791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87527032-cab8-484c-b1c8-aeceba2b982c service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:07.821992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 637/1270] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:10.236166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125b3e-e3fe-4be4-a43d-006bfea969c6 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:10.236784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125b3e-e3fe-4be4-a43d-006bfea969c6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:10.236784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125b3e-e3fe-4be4-a43d-006bfea969c6 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:10.238703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 634/1271] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:10.245417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a28fd-b128-48f9-9040-45e8a3340a47 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:10.246137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a28fd-b128-48f9-9040-45e8a3340a47 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:10.246137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a28fd-b128-48f9-9040-45e8a3340a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:10.318623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-384a28fd-b128-48f9-9040-45e8a3340a47 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:10.319843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-384a28fd-b128-48f9-9040-45e8a3340a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:10.423948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 638/1272] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:10.461624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5125b3e-e3fe-4be4-a43d-006bfea969c6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:10.463190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c5125b3e-e3fe-4be4-a43d-006bfea969c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:10.581876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5125b3e-e3fe-4be4-a43d-006bfea969c6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:10.672720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ea96-0440-4dc2-b3a3-c2c8d0627547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:10.673368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ea96-0440-4dc2-b3a3-c2c8d0627547 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:10.673696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ea96-0440-4dc2-b3a3-c2c8d0627547 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:10.673942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ea96-0440-4dc2-b3a3-c2c8d0627547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:10.675675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e8c2ea96-0440-4dc2-b3a3-c2c8d0627547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:10.794016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ea96-0440-4dc2-b3a3-c2c8d0627547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:10.795400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ea96-0440-4dc2-b3a3-c2c8d0627547 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:10.814644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 635/1273] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:13.286436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a559-e08f-42b4-829b-49c1e9ce5bf3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:13.287059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a559-e08f-42b4-829b-49c1e9ce5bf3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:13.287059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a559-e08f-42b4-829b-49c1e9ce5bf3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:13.288999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 639/1274] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:13.296101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:13.296705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:13.296705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:13.371377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:13.372513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:13.478053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 636/1275] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:13.511726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a559-e08f-42b4-829b-49c1e9ce5bf3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:13.513316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5d54a559-e08f-42b4-829b-49c1e9ce5bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:13.645506 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a559-e08f-42b4-829b-49c1e9ce5bf3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:13.751409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e68099-d2d3-4eac-b310-91dcfa40161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:13.752273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68099-d2d3-4eac-b310-91dcfa40161b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:13.752551 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68099-d2d3-4eac-b310-91dcfa40161b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:13.752825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e68099-d2d3-4eac-b310-91dcfa40161b admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:13.764579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e68099-d2d3-4eac-b310-91dcfa40161b admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:13.766750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e68099-d2d3-4eac-b310-91dcfa40161b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:13.768538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 640/1276] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:09:13 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:09:13.782215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:13.783453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:13.881560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30d4af-a2c9-4335-b489-f587e7970b26 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:13.964422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d311a2-ae1f-4f73-84aa-5736e0893fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:13.965096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d311a2-ae1f-4f73-84aa-5736e0893fda service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:13.965381 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d311a2-ae1f-4f73-84aa-5736e0893fda service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:13.965702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d311a2-ae1f-4f73-84aa-5736e0893fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:13.967439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-72d311a2-ae1f-4f73-84aa-5736e0893fda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:14.084213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d311a2-ae1f-4f73-84aa-5736e0893fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:14.085703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d311a2-ae1f-4f73-84aa-5736e0893fda service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:14.108537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 637/1277] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:16.720292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d6db4-06e4-4fd0-b8df-322872345615 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:16.720912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d6db4-06e4-4fd0-b8df-322872345615 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:16.720912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d6db4-06e4-4fd0-b8df-322872345615 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:16.722676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 641/1278] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:16.730026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2461edb-b8f5-41b9-845a-1c18db983ada None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:16.730890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2461edb-b8f5-41b9-845a-1c18db983ada None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:16.730890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2461edb-b8f5-41b9-845a-1c18db983ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:16.814647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f2461edb-b8f5-41b9-845a-1c18db983ada None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:16.815804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f2461edb-b8f5-41b9-845a-1c18db983ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:16.920203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 638/1279] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:16.959419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d6db4-06e4-4fd0-b8df-322872345615 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:16.961529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d54d6db4-06e4-4fd0-b8df-322872345615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:17.081294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d6db4-06e4-4fd0-b8df-322872345615 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:17.158675 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f53372-31a8-4a8e-9e7f-6aa49c82d631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:17.159328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53372-31a8-4a8e-9e7f-6aa49c82d631 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:17.159608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53372-31a8-4a8e-9e7f-6aa49c82d631 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:17.159875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f53372-31a8-4a8e-9e7f-6aa49c82d631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:17.161962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a5f53372-31a8-4a8e-9e7f-6aa49c82d631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:17.284225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f53372-31a8-4a8e-9e7f-6aa49c82d631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:17.286121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f53372-31a8-4a8e-9e7f-6aa49c82d631 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:17.305391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 642/1280] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:19.699417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667818-022a-4668-a55c-f2d4b3867b0b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:19.699971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667818-022a-4668-a55c-f2d4b3867b0b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:19.699971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02667818-022a-4668-a55c-f2d4b3867b0b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:19.701790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 639/1281] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:19.708836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109cb0-23c0-4ac1-9dc0-95267638d605 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:19.709404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109cb0-23c0-4ac1-9dc0-95267638d605 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:19.709404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76109cb0-23c0-4ac1-9dc0-95267638d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:19.786869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-76109cb0-23c0-4ac1-9dc0-95267638d605 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:19.788074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-76109cb0-23c0-4ac1-9dc0-95267638d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:19.899652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 643/1282] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:19.942125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02667818-022a-4668-a55c-f2d4b3867b0b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:19.944660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-02667818-022a-4668-a55c-f2d4b3867b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:20.047540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02667818-022a-4668-a55c-f2d4b3867b0b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:20.062842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85377455-d8e1-47ba-a918-8a5363df5d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:20.063676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377455-d8e1-47ba-a918-8a5363df5d06 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:20.064006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377455-d8e1-47ba-a918-8a5363df5d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:20.064330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85377455-d8e1-47ba-a918-8a5363df5d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:20.075634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377455-d8e1-47ba-a918-8a5363df5d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:20.077131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85377455-d8e1-47ba-a918-8a5363df5d06 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:20.088326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 640/1283] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:22.780796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a06c6-a1d5-4deb-929d-8e3d6ddd9494 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:22.781361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a06c6-a1d5-4deb-929d-8e3d6ddd9494 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:22.781361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a06c6-a1d5-4deb-929d-8e3d6ddd9494 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:22.783234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 644/1284] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:22.790418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fd80-5af8-4933-8518-c3d8c6b28379 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:22.790963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fd80-5af8-4933-8518-c3d8c6b28379 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:22.790963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39fd80-5af8-4933-8518-c3d8c6b28379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:22.809713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0e39fd80-5af8-4933-8518-c3d8c6b28379 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:22.810965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0e39fd80-5af8-4933-8518-c3d8c6b28379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:22.819475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 641/1285] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:09:22.860234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a06c6-a1d5-4deb-929d-8e3d6ddd9494 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:22.862346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c25a06c6-a1d5-4deb-929d-8e3d6ddd9494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:22.887586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a06c6-a1d5-4deb-929d-8e3d6ddd9494 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:22.891466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585fb11a-53cd-4194-aa86-31d0d3bc2b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:22.892113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb11a-53cd-4194-aa86-31d0d3bc2b40 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:22.892394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb11a-53cd-4194-aa86-31d0d3bc2b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:22.892669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585fb11a-53cd-4194-aa86-31d0d3bc2b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:22.903568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb11a-53cd-4194-aa86-31d0d3bc2b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:22.905092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585fb11a-53cd-4194-aa86-31d0d3bc2b40 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:22.916399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 645/1286] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:27.771333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c3e3-5fce-4b06-89e7-135b69690a2c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:27.771854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c3e3-5fce-4b06-89e7-135b69690a2c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:27.771854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad25c3e3-5fce-4b06-89e7-135b69690a2c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:27.774642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 642/1287] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:09:27.781454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9646-1400-4dea-8be2-72fd10f98ecd None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:27.782024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9646-1400-4dea-8be2-72fd10f98ecd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:27.782186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf9646-1400-4dea-8be2-72fd10f98ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:27.801352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2caf9646-1400-4dea-8be2-72fd10f98ecd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:27.802730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2caf9646-1400-4dea-8be2-72fd10f98ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:27.815420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 646/1288] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:27.857073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c3e3-5fce-4b06-89e7-135b69690a2c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:27.871972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad25c3e3-5fce-4b06-89e7-135b69690a2c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:27.876545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160756c-d9f3-4b2d-a731-311b32ddc700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:27.877314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160756c-d9f3-4b2d-a731-311b32ddc700 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:27.877632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160756c-d9f3-4b2d-a731-311b32ddc700 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:27.877909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160756c-d9f3-4b2d-a731-311b32ddc700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:27.889511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160756c-d9f3-4b2d-a731-311b32ddc700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:27.891095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160756c-d9f3-4b2d-a731-311b32ddc700 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:27.904169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 643/1289] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:09:30.937775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08d23-ebbc-4f95-ae61-d82dc1d335ff None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:30.938353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08d23-ebbc-4f95-ae61-d82dc1d335ff None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:30.938353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a08d23-ebbc-4f95-ae61-d82dc1d335ff None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:30.940093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 647/1290] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:30.948934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a915d-96db-4065-a136-e9e6a69e8cfc None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:30.949557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a915d-96db-4065-a136-e9e6a69e8cfc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:30.949557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a915d-96db-4065-a136-e9e6a69e8cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:30.967886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e00a915d-96db-4065-a136-e9e6a69e8cfc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:30.969079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e00a915d-96db-4065-a136-e9e6a69e8cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:30.977365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 644/1291] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:31.016478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a08d23-ebbc-4f95-ae61-d82dc1d335ff None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:31.029919 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a08d23-ebbc-4f95-ae61-d82dc1d335ff None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:31.034138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a20988-1ae0-47fa-b643-b5fc32c3a732 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:31.035487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20988-1ae0-47fa-b643-b5fc32c3a732 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:31.036136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20988-1ae0-47fa-b643-b5fc32c3a732 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:31.036648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a20988-1ae0-47fa-b643-b5fc32c3a732 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:31.050444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20988-1ae0-47fa-b643-b5fc32c3a732 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:31.053041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a20988-1ae0-47fa-b643-b5fc32c3a732 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:31.066296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 648/1292] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:36.228655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e7bc-87de-4b7b-8023-4b2f17bb6ac5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:36.229267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e7bc-87de-4b7b-8023-4b2f17bb6ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:36.229267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d2e7bc-87de-4b7b-8023-4b2f17bb6ac5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:36.233883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 645/1293] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:36 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:36.238836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a1a1-81c5-4b0d-8d05-c4e9cd1191ff None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:36.239465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a1a1-81c5-4b0d-8d05-c4e9cd1191ff None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:36.239465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111a1a1-81c5-4b0d-8d05-c4e9cd1191ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:36.265629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d111a1a1-81c5-4b0d-8d05-c4e9cd1191ff None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:36.267559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d111a1a1-81c5-4b0d-8d05-c4e9cd1191ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:36.280617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 649/1294] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:36.337269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2e7bc-87de-4b7b-8023-4b2f17bb6ac5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:36.363815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d2e7bc-87de-4b7b-8023-4b2f17bb6ac5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:36.368893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066314c-1039-4ba7-8046-a97656e55aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:36.370389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066314c-1039-4ba7-8046-a97656e55aad service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:36.370389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066314c-1039-4ba7-8046-a97656e55aad service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:36.370613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066314c-1039-4ba7-8046-a97656e55aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:36.382819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066314c-1039-4ba7-8046-a97656e55aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:36.384686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066314c-1039-4ba7-8046-a97656e55aad service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:36.397476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 646/1295] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:42.189840 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b527354-e26e-4830-83a9-8529a55cd400 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:42.190282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b527354-e26e-4830-83a9-8529a55cd400 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:42.190282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b527354-e26e-4830-83a9-8529a55cd400 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:42.191992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 650/1296] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:09:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:42.202788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae052-2b55-4024-85ef-c395f8dc89e3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:42.202788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae052-2b55-4024-85ef-c395f8dc89e3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:42.202788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ae052-2b55-4024-85ef-c395f8dc89e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:42.294462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1d2ae052-2b55-4024-85ef-c395f8dc89e3 None None] MFA Rules not processed for user `4ef0f0386b384a09a87bcce51d172598`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:42.295623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1d2ae052-2b55-4024-85ef-c395f8dc89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:42.397184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 647/1297] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:09:42 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:47.311519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3b4e-8a54-40a3-a55b-55b67ce81007 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:47.312099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3b4e-8a54-40a3-a55b-55b67ce81007 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:47.312215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f3b4e-8a54-40a3-a55b-55b67ce81007 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:47.314650 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 651/1298] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:09:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:47.320469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42115a5-1dae-4acd-a1cf-63a3b4e6b036 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:47.321238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42115a5-1dae-4acd-a1cf-63a3b4e6b036 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:47.321238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42115a5-1dae-4acd-a1cf-63a3b4e6b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:47.344564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e42115a5-1dae-4acd-a1cf-63a3b4e6b036 None None] MFA Rules not processed for user `4ef0f0386b384a09a87bcce51d172598`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:47.349023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e42115a5-1dae-4acd-a1cf-63a3b4e6b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:47.358409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 648/1299] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:09:47 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:49.254397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576f78-aae6-43d2-a9b4-496ee77a3906 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:49.255121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576f78-aae6-43d2-a9b4-496ee77a3906 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:49.255121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e576f78-aae6-43d2-a9b4-496ee77a3906 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:49.256694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 652/1300] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:09:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:09:49.262603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b3619-380c-4fea-b882-4df32d9ea92e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:49.263376 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b3619-380c-4fea-b882-4df32d9ea92e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:49.263571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b3619-380c-4fea-b882-4df32d9ea92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:49.286228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-655b3619-380c-4fea-b882-4df32d9ea92e None None] MFA Rules not processed for user `4ef0f0386b384a09a87bcce51d172598`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:49.287571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-655b3619-380c-4fea-b882-4df32d9ea92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:49.298237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 649/1301] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:09:49 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:53.142415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0deec7-0eb7-4ab4-951d-df8b6e615b4e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:53.142946 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0deec7-0eb7-4ab4-951d-df8b6e615b4e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:53.143533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0deec7-0eb7-4ab4-951d-df8b6e615b4e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:53.148389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 653/1302] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:53 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:53.155901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586ca6f-37f8-4921-b034-15f584bbf269 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:53.157000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586ca6f-37f8-4921-b034-15f584bbf269 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:53.157660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586ca6f-37f8-4921-b034-15f584bbf269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:53.180489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e586ca6f-37f8-4921-b034-15f584bbf269 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:53.182076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e586ca6f-37f8-4921-b034-15f584bbf269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:53.192944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 650/1303] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:53.290547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaac1f-1b73-46db-876a-6e7decf295f4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:53.290992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaac1f-1b73-46db-876a-6e7decf295f4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:53.291513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcaac1f-1b73-46db-876a-6e7decf295f4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:53.293644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 654/1304] 10.222.0.31 () {54 vars in 961 bytes} [Tue Nov 16 03:09:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:09:53.301032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e44728-2edd-4b51-9ce1-9c6fce9b9ad8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:53.301032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e44728-2edd-4b51-9ce1-9c6fce9b9ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:53.301324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e44728-2edd-4b51-9ce1-9c6fce9b9ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:53.359375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-59e44728-2edd-4b51-9ce1-9c6fce9b9ad8 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:53.361281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-59e44728-2edd-4b51-9ce1-9c6fce9b9ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:53.469600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 651/1305] 10.222.0.31 () {58 vars in 1058 bytes} [Tue Nov 16 03:09:53 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:53.478560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaac1f-1b73-46db-876a-6e7decf295f4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:53.498344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcaac1f-1b73-46db-876a-6e7decf295f4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:53.504348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e86bb-8668-4a7b-9156-9318052fbbf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:53.505142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e86bb-8668-4a7b-9156-9318052fbbf8 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:53.505622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e86bb-8668-4a7b-9156-9318052fbbf8 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:53.505993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e86bb-8668-4a7b-9156-9318052fbbf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:53.517156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e86bb-8668-4a7b-9156-9318052fbbf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:53.518939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e86bb-8668-4a7b-9156-9318052fbbf8 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:53.535669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 655/1306] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:56.268968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66841e1-6637-4cd8-99a5-158bf5790f9e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:56.269543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66841e1-6637-4cd8-99a5-158bf5790f9e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:56.269756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66841e1-6637-4cd8-99a5-158bf5790f9e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:56.271634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 652/1307] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:56.279904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe48c-0f51-4df4-85e9-ee053a6d2f14 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:56.280775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe48c-0f51-4df4-85e9-ee053a6d2f14 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:56.281206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fe48c-0f51-4df4-85e9-ee053a6d2f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:56.302388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9b6fe48c-0f51-4df4-85e9-ee053a6d2f14 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:56.303798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9b6fe48c-0f51-4df4-85e9-ee053a6d2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:56.313844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 656/1308] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:09:56.361222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66841e1-6637-4cd8-99a5-158bf5790f9e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:56.378765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66841e1-6637-4cd8-99a5-158bf5790f9e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:56.385652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b7a4-04a1-4ff1-a9a2-edf4f61ad29c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:56.386378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b7a4-04a1-4ff1-a9a2-edf4f61ad29c service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:56.386760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b7a4-04a1-4ff1-a9a2-edf4f61ad29c service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:56.387139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b7a4-04a1-4ff1-a9a2-edf4f61ad29c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:56.396659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848b7a4-04a1-4ff1-a9a2-edf4f61ad29c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:56.399108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848b7a4-04a1-4ff1-a9a2-edf4f61ad29c service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:56.410248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 653/1309] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:09:59.436706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb263ac-50bf-44d1-a324-23a1b7d2bbdb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:59.437271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb263ac-50bf-44d1-a324-23a1b7d2bbdb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:59.437480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb263ac-50bf-44d1-a324-23a1b7d2bbdb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:59.440021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 657/1310] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:09:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:59.447227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cbdd6-ba3c-44b7-ae20-4d99693adce2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:59.447670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cbdd6-ba3c-44b7-ae20-4d99693adce2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:59.447787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5cbdd6-ba3c-44b7-ae20-4d99693adce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:59.468031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2a5cbdd6-ba3c-44b7-ae20-4d99693adce2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:59.469273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2a5cbdd6-ba3c-44b7-ae20-4d99693adce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:59.478591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 654/1311] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:09:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:59.528075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4fae4-96a9-45d6-8f74-928b19143234 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:59.528441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4fae4-96a9-45d6-8f74-928b19143234 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:59.528795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4fae4-96a9-45d6-8f74-928b19143234 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:59.531053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 658/1312] 10.222.0.31 () {54 vars in 961 bytes} [Tue Nov 16 03:09:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:09:59.545672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66feca8-f8f8-4b5d-bf66-866e6694dcd5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:59.545958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66feca8-f8f8-4b5d-bf66-866e6694dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:59.546232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66feca8-f8f8-4b5d-bf66-866e6694dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:59.567791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f66feca8-f8f8-4b5d-bf66-866e6694dcd5 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:09:59.570213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f66feca8-f8f8-4b5d-bf66-866e6694dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:09:59.579572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 655/1313] 10.222.0.31 () {58 vars in 1058 bytes} [Tue Nov 16 03:09:59 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:09:59.588732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4fae4-96a9-45d6-8f74-928b19143234 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:09:59.604759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4fae4-96a9-45d6-8f74-928b19143234 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:09:59.610961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fe0d6-127d-45cc-a4ce-60e97a9e16dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:09:59.611643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fe0d6-127d-45cc-a4ce-60e97a9e16dc service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:09:59.611924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fe0d6-127d-45cc-a4ce-60e97a9e16dc service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:09:59.612199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fe0d6-127d-45cc-a4ce-60e97a9e16dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:09:59.624867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fe0d6-127d-45cc-a4ce-60e97a9e16dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:09:59.626547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fe0d6-127d-45cc-a4ce-60e97a9e16dc service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:09:59.637785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 659/1314] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:09:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:02.166434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75ff3-fcd0-451f-a8fc-27ca512bbd3a None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.166967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75ff3-fcd0-451f-a8fc-27ca512bbd3a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.167201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d75ff3-fcd0-451f-a8fc-27ca512bbd3a None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.169397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 656/1315] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:10:02.176053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e608c6-68b0-4b7d-b512-0403078a9f95 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.176544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e608c6-68b0-4b7d-b512-0403078a9f95 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.176636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e608c6-68b0-4b7d-b512-0403078a9f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.198874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d6e608c6-68b0-4b7d-b512-0403078a9f95 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:02.200112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d6e608c6-68b0-4b7d-b512-0403078a9f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:02.211095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 660/1316] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:02.264161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d75ff3-fcd0-451f-a8fc-27ca512bbd3a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:02.284851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd649a-a683-47f0-8ef9-f59ef4d67bf0 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.285753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd649a-a683-47f0-8ef9-f59ef4d67bf0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.286227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd649a-a683-47f0-8ef9-f59ef4d67bf0 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.290097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d75ff3-fcd0-451f-a8fc-27ca512bbd3a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:02.290871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 661/1317] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:02 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:02.302068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56fd0b-8a9c-4005-832c-82ae8d08b2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:02.302303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43c16-9ca8-432d-b657-55fe3f809329 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.302719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43c16-9ca8-432d-b657-55fe3f809329 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.303114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56fd0b-8a9c-4005-832c-82ae8d08b2d5 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.303245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c43c16-9ca8-432d-b657-55fe3f809329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.304219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56fd0b-8a9c-4005-832c-82ae8d08b2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.304713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56fd0b-8a9c-4005-832c-82ae8d08b2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.320132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56fd0b-8a9c-4005-832c-82ae8d08b2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:02.323132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56fd0b-8a9c-4005-832c-82ae8d08b2d5 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:02.329299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-86c43c16-9ca8-432d-b657-55fe3f809329 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:02.330784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-86c43c16-9ca8-432d-b657-55fe3f809329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:02.345486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 662/1318] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:10:02.345703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 657/1319] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:02.436082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce7ec-04bb-4feb-8aca-e9bea7e705a0 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.436438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce7ec-04bb-4feb-8aca-e9bea7e705a0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.436922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ce7ec-04bb-4feb-8aca-e9bea7e705a0 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.440477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 663/1320] 10.222.0.31 () {54 vars in 962 bytes} [Tue Nov 16 03:10:02 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:02.459947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090434eb-d2cb-49e0-ad48-4782adc24d81 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.461532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090434eb-d2cb-49e0-ad48-4782adc24d81 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.462299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090434eb-d2cb-49e0-ad48-4782adc24d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.551465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-090434eb-d2cb-49e0-ad48-4782adc24d81 None None] MFA Rules not processed for user `2904526cac37478bb9fd712ac29f86f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:02.554575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-090434eb-d2cb-49e0-ad48-4782adc24d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:02.663067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 658/1321] 10.222.0.31 () {58 vars in 1059 bytes} [Tue Nov 16 03:10:02 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:02.673959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ce7ec-04bb-4feb-8aca-e9bea7e705a0 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:02.689883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ce7ec-04bb-4feb-8aca-e9bea7e705a0 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:02.695204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf0ccd-62c7-4a26-99c7-14a54ea4aa5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:02.696266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0ccd-62c7-4a26-99c7-14a54ea4aa5f service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:02.696698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0ccd-62c7-4a26-99c7-14a54ea4aa5f service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:02.697302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf0ccd-62c7-4a26-99c7-14a54ea4aa5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:02.710905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf0ccd-62c7-4a26-99c7-14a54ea4aa5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:02.713789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf0ccd-62c7-4a26-99c7-14a54ea4aa5f service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:02.727778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 664/1322] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:04.904401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb146-105b-41d4-baeb-c938b7eaba3f None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:04.905037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb146-105b-41d4-baeb-c938b7eaba3f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:04.905252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbb146-105b-41d4-baeb-c938b7eaba3f None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:04.907932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 659/1323] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:04.915389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c820-9479-48dd-8925-456499b728b1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:04.916018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c820-9479-48dd-8925-456499b728b1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:04.916018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6c820-9479-48dd-8925-456499b728b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:04.934995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6ca6c820-9479-48dd-8925-456499b728b1 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:04.936207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6ca6c820-9479-48dd-8925-456499b728b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:04.948467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 665/1324] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:05.000021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbb146-105b-41d4-baeb-c938b7eaba3f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:05.016268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbb146-105b-41d4-baeb-c938b7eaba3f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:05.024111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a5a5e-1d6b-4a80-a3ee-d6bd96906840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:05.024792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5a5e-1d6b-4a80-a3ee-d6bd96906840 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:05.025070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5a5e-1d6b-4a80-a3ee-d6bd96906840 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:05.025342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a5a5e-1d6b-4a80-a3ee-d6bd96906840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:05.035755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a5a5e-1d6b-4a80-a3ee-d6bd96906840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:05.037476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a5a5e-1d6b-4a80-a3ee-d6bd96906840 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:05.049257 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 660/1325] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:07.662503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4a2a-5b29-474e-a424-e50d4efe29ab None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:07.662503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4a2a-5b29-474e-a424-e50d4efe29ab None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:07.662503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4a2a-5b29-474e-a424-e50d4efe29ab None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:07.664651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 666/1326] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:07.671305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3f17-d871-4927-9b72-30bc0c075908 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:07.672018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3f17-d871-4927-9b72-30bc0c075908 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:07.672018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a3f17-d871-4927-9b72-30bc0c075908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:07.692610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-491a3f17-d871-4927-9b72-30bc0c075908 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:07.694078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-491a3f17-d871-4927-9b72-30bc0c075908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:07.702967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 661/1327] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:10:07.754398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4a2a-5b29-474e-a424-e50d4efe29ab None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:07.771027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4a2a-5b29-474e-a424-e50d4efe29ab None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:07.777095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1ba83-bdaa-497f-bba7-e9b860d7fa43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:07.778042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1ba83-bdaa-497f-bba7-e9b860d7fa43 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:07.778312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1ba83-bdaa-497f-bba7-e9b860d7fa43 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:07.778783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1ba83-bdaa-497f-bba7-e9b860d7fa43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:07.789790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1ba83-bdaa-497f-bba7-e9b860d7fa43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:07.791485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1ba83-bdaa-497f-bba7-e9b860d7fa43 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:07.802325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 667/1328] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:10:10.514471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad275-4371-45e8-bd79-ccb7f4239f39 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:10.515554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad275-4371-45e8-bd79-ccb7f4239f39 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:10.516177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbad275-4371-45e8-bd79-ccb7f4239f39 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:10.519632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 662/1329] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:10.526552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c6a1f-9677-4ec1-88bb-92d94e5c8798 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:10.527160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c6a1f-9677-4ec1-88bb-92d94e5c8798 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:10.527160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c6a1f-9677-4ec1-88bb-92d94e5c8798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:10.548374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ef3c6a1f-9677-4ec1-88bb-92d94e5c8798 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:10.549655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ef3c6a1f-9677-4ec1-88bb-92d94e5c8798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:10.560662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 668/1330] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:10.607812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad275-4371-45e8-bd79-ccb7f4239f39 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:10.623005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbad275-4371-45e8-bd79-ccb7f4239f39 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:10.628862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d895dc6-def8-4065-857a-fc540cc15584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:10.629632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895dc6-def8-4065-857a-fc540cc15584 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:10.629910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895dc6-def8-4065-857a-fc540cc15584 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:10.630388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895dc6-def8-4065-857a-fc540cc15584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:10.640189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d895dc6-def8-4065-857a-fc540cc15584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:10.641859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d895dc6-def8-4065-857a-fc540cc15584 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:10.652690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 663/1331] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:13.157256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb4ef-b3ee-430c-8b20-d4bd60d128bb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:13.158469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb4ef-b3ee-430c-8b20-d4bd60d128bb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:13.159099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfb4ef-b3ee-430c-8b20-d4bd60d128bb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:13.162147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 669/1332] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:13 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:13.169787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca97d-b277-4c94-8100-c9be15a6abc0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:13.170330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca97d-b277-4c94-8100-c9be15a6abc0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:13.170517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ca97d-b277-4c94-8100-c9be15a6abc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:13.194984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-dc0ca97d-b277-4c94-8100-c9be15a6abc0 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:13.196694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dc0ca97d-b277-4c94-8100-c9be15a6abc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:13.207264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 664/1333] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:13.259567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfb4ef-b3ee-430c-8b20-d4bd60d128bb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:13.276271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfb4ef-b3ee-430c-8b20-d4bd60d128bb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:13.281983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c0fe5-71f4-44ab-a6a8-b39b909d9671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:13.282691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0fe5-71f4-44ab-a6a8-b39b909d9671 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:13.282968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0fe5-71f4-44ab-a6a8-b39b909d9671 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:13.283258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c0fe5-71f4-44ab-a6a8-b39b909d9671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:13.294857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0fe5-71f4-44ab-a6a8-b39b909d9671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:13.297645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c0fe5-71f4-44ab-a6a8-b39b909d9671 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:13.309590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 670/1334] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:15.889872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae552-d7c7-40ca-a701-61ce0396e9eb None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:15.890481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae552-d7c7-40ca-a701-61ce0396e9eb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:15.890481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ae552-d7c7-40ca-a701-61ce0396e9eb None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:15.892598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 665/1335] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:15.903112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10594-9f95-4843-947d-64f9a92cb118 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:15.903770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10594-9f95-4843-947d-64f9a92cb118 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:15.903770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef10594-9f95-4843-947d-64f9a92cb118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:15.925564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cef10594-9f95-4843-947d-64f9a92cb118 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:15.926903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cef10594-9f95-4843-947d-64f9a92cb118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:15.936581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 671/1336] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:10:15.998082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ae552-d7c7-40ca-a701-61ce0396e9eb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:16.015791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ae552-d7c7-40ca-a701-61ce0396e9eb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:16.024595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a690e2-ffd8-4d11-8c51-344ef435e84c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:16.025306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a690e2-ffd8-4d11-8c51-344ef435e84c service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:16.025638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a690e2-ffd8-4d11-8c51-344ef435e84c service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:16.025925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a690e2-ffd8-4d11-8c51-344ef435e84c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:16.036687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a690e2-ffd8-4d11-8c51-344ef435e84c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:16.038788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a690e2-ffd8-4d11-8c51-344ef435e84c service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:16.050156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 666/1337] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:18.762756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29fdf-cd91-429e-b090-5fe06211365c None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:18.763346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29fdf-cd91-429e-b090-5fe06211365c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:18.763455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a29fdf-cd91-429e-b090-5fe06211365c None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:18.766774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 672/1338] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:18.778857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc87db-0765-4531-ad64-0cc1a5b1877d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:18.779389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc87db-0765-4531-ad64-0cc1a5b1877d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:18.779906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc87db-0765-4531-ad64-0cc1a5b1877d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:18.814206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d1cc87db-0765-4531-ad64-0cc1a5b1877d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:18.815508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d1cc87db-0765-4531-ad64-0cc1a5b1877d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:18.826348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 667/1339] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:18.894703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29fdf-cd91-429e-b090-5fe06211365c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:18.918713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a29fdf-cd91-429e-b090-5fe06211365c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:18.927104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca543e01-697d-42ae-8cdf-fdb518185e14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:18.927810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543e01-697d-42ae-8cdf-fdb518185e14 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:18.928085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543e01-697d-42ae-8cdf-fdb518185e14 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:18.928354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca543e01-697d-42ae-8cdf-fdb518185e14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:18.937971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543e01-697d-42ae-8cdf-fdb518185e14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:18.939618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca543e01-697d-42ae-8cdf-fdb518185e14 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:18.954766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 673/1340] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:20.146956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a54ac-e815-4faa-a0ac-2a0d4675e7ee None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:20.147494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a54ac-e815-4faa-a0ac-2a0d4675e7ee None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:20.147846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87a54ac-e815-4faa-a0ac-2a0d4675e7ee None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:20.151581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 668/1341] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:20.158773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1df22-27fb-48e7-8166-b844725cb77c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:20.159272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1df22-27fb-48e7-8166-b844725cb77c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:20.159658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1df22-27fb-48e7-8166-b844725cb77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:20.186797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bef1df22-27fb-48e7-8166-b844725cb77c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:20.188957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bef1df22-27fb-48e7-8166-b844725cb77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:20.204036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 674/1342] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:10:20.269265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea5088-ce09-4b79-87b3-0196f977e74e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:20.269921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea5088-ce09-4b79-87b3-0196f977e74e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:20.270546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea5088-ce09-4b79-87b3-0196f977e74e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:20.274242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 669/1343] 10.222.0.31 () {54 vars in 962 bytes} [Tue Nov 16 03:10:20 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:10:20.283329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d20e-6189-424f-8880-1680250ffed2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:20.283770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d20e-6189-424f-8880-1680250ffed2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:20.284046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8d20e-6189-424f-8880-1680250ffed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:20.363729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-33f8d20e-6189-424f-8880-1680250ffed2 None None] MFA Rules not processed for user `c3fd595065064131926ed83613a82ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:20.364975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-33f8d20e-6189-424f-8880-1680250ffed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:20.447319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 675/1344] 10.222.0.31 () {58 vars in 1059 bytes} [Tue Nov 16 03:10:20 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:20.463101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea5088-ce09-4b79-87b3-0196f977e74e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:20.475892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea5088-ce09-4b79-87b3-0196f977e74e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:20.480277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad3839-754f-4d3c-aedb-8219f30b4f7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:20.481114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad3839-754f-4d3c-aedb-8219f30b4f7c service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:20.481466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad3839-754f-4d3c-aedb-8219f30b4f7c service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:20.481864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad3839-754f-4d3c-aedb-8219f30b4f7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:20.493264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad3839-754f-4d3c-aedb-8219f30b4f7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:20.495038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad3839-754f-4d3c-aedb-8219f30b4f7c service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:20.507102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 670/1345] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:10:21.244846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2db24-e3f1-4349-abaa-0cab2156df34 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:21.245732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2db24-e3f1-4349-abaa-0cab2156df34 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:21.245732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2db24-e3f1-4349-abaa-0cab2156df34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:21.296619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f0b2db24-e3f1-4349-abaa-0cab2156df34 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:21.297880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f0b2db24-e3f1-4349-abaa-0cab2156df34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:21.377965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 676/1346] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:10:21 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:10:21.441413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae77a9-51ec-46d1-a058-5d861c0afaed None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:21.442103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae77a9-51ec-46d1-a058-5d861c0afaed None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:21.442690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae77a9-51ec-46d1-a058-5d861c0afaed None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:21.446501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 671/1347] 10.222.0.31 () {54 vars in 942 bytes} [Tue Nov 16 03:10:21 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:21.454893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d39f5-74bf-4d97-a6af-851c97a8b1e3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:21.455184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d39f5-74bf-4d97-a6af-851c97a8b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:21.455464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d39f5-74bf-4d97-a6af-851c97a8b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:21.496860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa830-2707-4a3a-82ee-a7f6ec97ffe3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:21.497139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa830-2707-4a3a-82ee-a7f6ec97ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:21.497566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfa830-2707-4a3a-82ee-a7f6ec97ffe3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:21.499829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 672/1348] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:21.506872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15609bd-ad93-4b78-9449-1da90ec2e034 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:21.507401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15609bd-ad93-4b78-9449-1da90ec2e034 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:21.507921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15609bd-ad93-4b78-9449-1da90ec2e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:21.510035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7d1d39f5-74bf-4d97-a6af-851c97a8b1e3 None None] MFA Rules not processed for user `b580550112ae4c51a3bffea61ede5bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:21.511318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7d1d39f5-74bf-4d97-a6af-851c97a8b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:21.538682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d15609bd-ad93-4b78-9449-1da90ec2e034 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:21.539992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d15609bd-ad93-4b78-9449-1da90ec2e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:21.548281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 673/1349] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:10:21.612258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15609bd-ad93-4b78-9449-1da90ec2e034 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:21.612512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 677/1350] 10.222.0.31 () {58 vars in 1039 bytes} [Tue Nov 16 03:10:21 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:21.623222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d39f5-74bf-4d97-a6af-851c97a8b1e3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:21.632028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15609bd-ad93-4b78-9449-1da90ec2e034 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:21.636466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d39f5-74bf-4d97-a6af-851c97a8b1e3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:21.638161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e218f-3815-42f9-bdc6-6fd339b62f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:21.638733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e218f-3815-42f9-bdc6-6fd339b62f50 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:21.639010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e218f-3815-42f9-bdc6-6fd339b62f50 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:21.639407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e218f-3815-42f9-bdc6-6fd339b62f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:21.643159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9415daa0-dc04-4d4d-b913-4c456abce015 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:21.648470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e218f-3815-42f9-bdc6-6fd339b62f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:21.648761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415daa0-dc04-4d4d-b913-4c456abce015 service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:21.649163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415daa0-dc04-4d4d-b913-4c456abce015 service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:21.649491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9415daa0-dc04-4d4d-b913-4c456abce015 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:21.650469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e218f-3815-42f9-bdc6-6fd339b62f50 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:21.661645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 674/1351] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:21.661836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415daa0-dc04-4d4d-b913-4c456abce015 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:21.664112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9415daa0-dc04-4d4d-b913-4c456abce015 service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:21.675939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 678/1352] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:10:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:10:24.147635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e342-a6f3-401a-b580-2766a2e1e012 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:24.148205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e342-a6f3-401a-b580-2766a2e1e012 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:24.148205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56e342-a6f3-401a-b580-2766a2e1e012 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:24.150030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 675/1353] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:10:24.162029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a01a92-bf98-442b-8b88-324d8782130d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:24.162807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a01a92-bf98-442b-8b88-324d8782130d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:24.163106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a01a92-bf98-442b-8b88-324d8782130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:24.197079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-77a01a92-bf98-442b-8b88-324d8782130d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:24.199303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-77a01a92-bf98-442b-8b88-324d8782130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:24.222827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 679/1354] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:24.290101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56e342-a6f3-401a-b580-2766a2e1e012 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:24.323763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56e342-a6f3-401a-b580-2766a2e1e012 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:24.334718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548ba03-982d-42ad-ba51-33e616bdff23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:24.335401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548ba03-982d-42ad-ba51-33e616bdff23 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:24.335687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548ba03-982d-42ad-ba51-33e616bdff23 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:24.335959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548ba03-982d-42ad-ba51-33e616bdff23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:24.345621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548ba03-982d-42ad-ba51-33e616bdff23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:24.347233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e548ba03-982d-42ad-ba51-33e616bdff23 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:24.363101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 676/1355] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:10:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:10:39.910534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659c77-ebe9-47e1-b891-cbc189a5ea46 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:39.911142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659c77-ebe9-47e1-b891-cbc189a5ea46 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:39.911142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c659c77-ebe9-47e1-b891-cbc189a5ea46 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:39.913305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 680/1356] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:39.919703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe294-1e35-435b-ab2d-87541b8c732c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:39.920147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe294-1e35-435b-ab2d-87541b8c732c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:39.920266 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dfe294-1e35-435b-ab2d-87541b8c732c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:39.939594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-77dfe294-1e35-435b-ab2d-87541b8c732c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:39.940813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-77dfe294-1e35-435b-ab2d-87541b8c732c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:39.950187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 677/1357] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:39.975132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659c77-ebe9-47e1-b891-cbc189a5ea46 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:39.989714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c659c77-ebe9-47e1-b891-cbc189a5ea46 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:39.995491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fedbd6-d3b2-45ed-8d06-8ab460f71360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:39.996137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedbd6-d3b2-45ed-8d06-8ab460f71360 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:39.996408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedbd6-d3b2-45ed-8d06-8ab460f71360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:39.996673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fedbd6-d3b2-45ed-8d06-8ab460f71360 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:39.997414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fedbd6-d3b2-45ed-8d06-8ab460f71360 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:39.999337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fedbd6-d3b2-45ed-8d06-8ab460f71360 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:40.020843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 681/1358] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:10:39 2021] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:10:42.282093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1866-d504-4a9c-b2e9-6bcbb4023ca3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:42.282827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1866-d504-4a9c-b2e9-6bcbb4023ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:42.282827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1866-d504-4a9c-b2e9-6bcbb4023ca3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:42.284458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 678/1359] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:42.291371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb472cf-2e48-4e13-abf9-1ac64d264fce None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:42.291850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb472cf-2e48-4e13-abf9-1ac64d264fce None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:42.291960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb472cf-2e48-4e13-abf9-1ac64d264fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:42.310368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ebb472cf-2e48-4e13-abf9-1ac64d264fce None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:42.311580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ebb472cf-2e48-4e13-abf9-1ac64d264fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:42.320795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 682/1360] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:42.344831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1866-d504-4a9c-b2e9-6bcbb4023ca3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:42.359430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1866-d504-4a9c-b2e9-6bcbb4023ca3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:42.364681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:42.365903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:42.366204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:42.366467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] PATH_INFO: `/v3/projects/1553b5a1fd044efd942a69ded741565d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:42.378564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] RBAC: Authorizing `identity:get_project(project_id=1553b5a1fd044efd942a69ded741565d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:42.380933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:42.383013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 679/1361] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:10:42 2021] GET /identity/v3/projects/1553b5a1fd044efd942a69ded741565d => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:42.390178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb472cf-2e48-4e13-abf9-1ac64d264fce None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:42.399555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb472cf-2e48-4e13-abf9-1ac64d264fce None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:42.404408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:42.405064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:42.405335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:42.405636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:42.406418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] RBAC: Adding query filter params (scope.project.id=1553b5a1fd044efd942a69ded741565d) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:10:42.406725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:42.408565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:42.417094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 683/1362] 10.222.0.31 () {56 vars in 1231 bytes} [Tue Nov 16 03:10:42 2021] GET /identity/v3/role_assignments?scope.project.id=1553b5a1fd044efd942a69ded741565d => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:10:42.424123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:42.434933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1cb9c-7797-4b6a-b83b-252a2d40a8cc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:42.440749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1455a7a7-cc17-410d-8076-828aa8fb9f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:42.441664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a7a7-cc17-410d-8076-828aa8fb9f0e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:42.441947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a7a7-cc17-410d-8076-828aa8fb9f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:42.442218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1455a7a7-cc17-410d-8076-828aa8fb9f0e admin admin] PATH_INFO: `/v3/users/5029a5f098df4602a858aca99c122b4e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:42.457498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a7a7-cc17-410d-8076-828aa8fb9f0e admin admin] RBAC: Authorizing `identity:get_user(user_id=5029a5f098df4602a858aca99c122b4e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:42.460075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1455a7a7-cc17-410d-8076-828aa8fb9f0e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:42.461855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 680/1363] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:42 2021] GET /identity/v3/users/5029a5f098df4602a858aca99c122b4e => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:42.468854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:42.479404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182a507-175c-44db-8cb1-a144321049ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:42.484963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4787bba-d475-4ccb-b365-ee2988055b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:42.485970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4787bba-d475-4ccb-b365-ee2988055b61 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:42.486123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4787bba-d475-4ccb-b365-ee2988055b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:42.486383 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4787bba-d475-4ccb-b365-ee2988055b61 admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:42.487714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4787bba-d475-4ccb-b365-ee2988055b61 admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:42.489553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4787bba-d475-4ccb-b365-ee2988055b61 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:42.491271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 684/1364] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:42 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:44.953559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb000-b978-4f7f-a312-f2446dae35e6 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:44.954145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb000-b978-4f7f-a312-f2446dae35e6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:44.954145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eeb000-b978-4f7f-a312-f2446dae35e6 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:44.955986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 681/1365] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:44.962629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c589f-ee1a-4d23-a53c-85a02fad9763 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:44.963153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c589f-ee1a-4d23-a53c-85a02fad9763 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:44.963153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c589f-ee1a-4d23-a53c-85a02fad9763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:44.982076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d46c589f-ee1a-4d23-a53c-85a02fad9763 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:44.983285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d46c589f-ee1a-4d23-a53c-85a02fad9763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:44.992201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 685/1366] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:45.016161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeb000-b978-4f7f-a312-f2446dae35e6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:45.029694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eeb000-b978-4f7f-a312-f2446dae35e6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:45.034318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:45.035536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:45.035807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:45.036075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] PATH_INFO: `/v3/projects/34c85d80dd524131aedfb552ce8fe0fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:45.047201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] RBAC: Authorizing `identity:get_project(project_id=34c85d80dd524131aedfb552ce8fe0fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:45.049254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:45.051029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 682/1367] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:10:45 2021] GET /identity/v3/projects/34c85d80dd524131aedfb552ce8fe0fe => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:45.058405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c589f-ee1a-4d23-a53c-85a02fad9763 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:45.068460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c589f-ee1a-4d23-a53c-85a02fad9763 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:45.073678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fc02a-7eaf-4176-bea8-035ed109c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:45.074339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fc02a-7eaf-4176-bea8-035ed109c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:45.074615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fc02a-7eaf-4176-bea8-035ed109c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:45.074882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fc02a-7eaf-4176-bea8-035ed109c7c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:45.075672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fc02a-7eaf-4176-bea8-035ed109c7c8 admin admin] RBAC: Adding query filter params (scope.project.id=34c85d80dd524131aedfb552ce8fe0fe) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:10:45.075975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fc02a-7eaf-4176-bea8-035ed109c7c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:45.077896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fc02a-7eaf-4176-bea8-035ed109c7c8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:45.085814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 686/1368] 10.222.0.31 () {56 vars in 1231 bytes} [Tue Nov 16 03:10:45 2021] GET /identity/v3/role_assignments?scope.project.id=34c85d80dd524131aedfb552ce8fe0fe => generated 526 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:45.091634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:45.102592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e2f60-1a41-4816-a018-e711ce767471 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:45.108343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ba87-775a-495b-bcad-e74c90cd11c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:45.109239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ba87-775a-495b-bcad-e74c90cd11c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:45.109535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ba87-775a-495b-bcad-e74c90cd11c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:45.109826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ba87-775a-495b-bcad-e74c90cd11c0 admin admin] PATH_INFO: `/v3/users/08ada2c851604c33a82b81e92de36d90` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:45.125684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ba87-775a-495b-bcad-e74c90cd11c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=08ada2c851604c33a82b81e92de36d90)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:45.127840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ba87-775a-495b-bcad-e74c90cd11c0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:45.129704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 683/1369] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:45 2021] GET /identity/v3/users/08ada2c851604c33a82b81e92de36d90 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:47.472227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cf9b-b7c5-4422-a6e7-9c7aa8724f45 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:47.472818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cf9b-b7c5-4422-a6e7-9c7aa8724f45 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:47.472818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cf9b-b7c5-4422-a6e7-9c7aa8724f45 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:47.474632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 687/1370] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:47.481131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cf3b5-8138-4134-9230-00c7231716fb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:47.481674 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cf3b5-8138-4134-9230-00c7231716fb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:47.481771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397cf3b5-8138-4134-9230-00c7231716fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:47.500443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-397cf3b5-8138-4134-9230-00c7231716fb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:47.501690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-397cf3b5-8138-4134-9230-00c7231716fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:47.510241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 684/1371] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:47.534623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633cf9b-b7c5-4422-a6e7-9c7aa8724f45 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:47.549464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633cf9b-b7c5-4422-a6e7-9c7aa8724f45 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:47.554913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:47.555816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:47.556328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:47.556763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] PATH_INFO: `/v3/projects/5594fed9412c45a5a47a71b09b423a84` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:47.570045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5594fed9412c45a5a47a71b09b423a84)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:47.572331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:47.574261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 688/1372] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:10:47 2021] GET /identity/v3/projects/5594fed9412c45a5a47a71b09b423a84 => generated 361 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:47.581456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cf3b5-8138-4134-9230-00c7231716fb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:47.591522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397cf3b5-8138-4134-9230-00c7231716fb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:47.597201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a988d6-da27-4eb3-9a8d-91b6b94c2a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:47.597913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a988d6-da27-4eb3-9a8d-91b6b94c2a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:47.598192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a988d6-da27-4eb3-9a8d-91b6b94c2a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:47.598463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a988d6-da27-4eb3-9a8d-91b6b94c2a93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:47.599536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a988d6-da27-4eb3-9a8d-91b6b94c2a93 admin admin] RBAC: Adding query filter params (scope.project.id=5594fed9412c45a5a47a71b09b423a84) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:10:47.599841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a988d6-da27-4eb3-9a8d-91b6b94c2a93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:47.601759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a988d6-da27-4eb3-9a8d-91b6b94c2a93 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:47.609028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 685/1373] 10.222.0.31 () {56 vars in 1231 bytes} [Tue Nov 16 03:10:47 2021] GET /identity/v3/role_assignments?scope.project.id=5594fed9412c45a5a47a71b09b423a84 => generated 526 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:47.616666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:47.627780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0085d-5bd7-4429-a2c0-d29da14e89a9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:47.634177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc101fb-bac0-4455-949a-a0a3403bcdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:47.635045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc101fb-bac0-4455-949a-a0a3403bcdee admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:47.635318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc101fb-bac0-4455-949a-a0a3403bcdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:47.635587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc101fb-bac0-4455-949a-a0a3403bcdee admin admin] PATH_INFO: `/v3/users/909c0abc00794eb18e5047bd75b57661` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:47.655247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc101fb-bac0-4455-949a-a0a3403bcdee admin admin] RBAC: Authorizing `identity:get_user(user_id=909c0abc00794eb18e5047bd75b57661)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:47.657423 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc101fb-bac0-4455-949a-a0a3403bcdee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:47.659211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 689/1374] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:47 2021] GET /identity/v3/users/909c0abc00794eb18e5047bd75b57661 => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:49.999595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6283-a5cd-47e7-8248-6ab94d619e99 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:50.000179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6283-a5cd-47e7-8248-6ab94d619e99 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:50.000179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6283-a5cd-47e7-8248-6ab94d619e99 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:50.002011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 686/1375] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:50.008783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0359b-7c32-4853-bade-954885c9bf00 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:50.009321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0359b-7c32-4853-bade-954885c9bf00 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:50.009792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0359b-7c32-4853-bade-954885c9bf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:50.033899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-51d0359b-7c32-4853-bade-954885c9bf00 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:50.035641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-51d0359b-7c32-4853-bade-954885c9bf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:50.046251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 690/1376] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:50.070694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6283-a5cd-47e7-8248-6ab94d619e99 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:50.084635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6283-a5cd-47e7-8248-6ab94d619e99 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:50.089554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:50.090294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:50.090576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:50.090852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] PATH_INFO: `/v3/projects/91c341a2a38b4d9e843a2ec27ec136af` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:50.103052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] RBAC: Authorizing `identity:get_project(project_id=91c341a2a38b4d9e843a2ec27ec136af)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:50.105168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:50.106994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 687/1377] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:10:50 2021] GET /identity/v3/projects/91c341a2a38b4d9e843a2ec27ec136af => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:50.114029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0359b-7c32-4853-bade-954885c9bf00 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:50.123805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0359b-7c32-4853-bade-954885c9bf00 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:50.129746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dcfe7f-fe81-4dc3-98fe-a45143ac5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:50.130527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfe7f-fe81-4dc3-98fe-a45143ac5f75 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:50.130854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfe7f-fe81-4dc3-98fe-a45143ac5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:50.131129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dcfe7f-fe81-4dc3-98fe-a45143ac5f75 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:50.131928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcfe7f-fe81-4dc3-98fe-a45143ac5f75 admin admin] RBAC: Adding query filter params (scope.project.id=91c341a2a38b4d9e843a2ec27ec136af) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:10:50.132230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcfe7f-fe81-4dc3-98fe-a45143ac5f75 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:50.134132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dcfe7f-fe81-4dc3-98fe-a45143ac5f75 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:50.140332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 691/1378] 10.222.0.31 () {56 vars in 1231 bytes} [Tue Nov 16 03:10:50 2021] GET /identity/v3/role_assignments?scope.project.id=91c341a2a38b4d9e843a2ec27ec136af => generated 526 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:50.147244 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:50.157809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb1f54-8a2a-4a4e-be9d-91211693c371 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:50.164390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176e4df-2acf-4a60-83f6-4178dff5d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:50.165265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e4df-2acf-4a60-83f6-4178dff5d4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:50.165575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e4df-2acf-4a60-83f6-4178dff5d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:50.165847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176e4df-2acf-4a60-83f6-4178dff5d4e8 admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:50.181745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176e4df-2acf-4a60-83f6-4178dff5d4e8 admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:50.183909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176e4df-2acf-4a60-83f6-4178dff5d4e8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:50.185623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 688/1379] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:50 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:52.542977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d713e-e08b-443b-b683-1080f9d0dd54 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:52.543535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d713e-e08b-443b-b683-1080f9d0dd54 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:52.543535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d713e-e08b-443b-b683-1080f9d0dd54 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:52.545349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 692/1380] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:52.551836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961673ff-5b28-422b-a8e3-472e425b48f3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:52.552839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961673ff-5b28-422b-a8e3-472e425b48f3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:52.552839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961673ff-5b28-422b-a8e3-472e425b48f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:52.572741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-961673ff-5b28-422b-a8e3-472e425b48f3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:52.574072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-961673ff-5b28-422b-a8e3-472e425b48f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:52.584969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 689/1381] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:52.609347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d713e-e08b-443b-b683-1080f9d0dd54 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:52.627295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d713e-e08b-443b-b683-1080f9d0dd54 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:52.632537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:52.633461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:52.633746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:52.634009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] PATH_INFO: `/v3/projects/a7cbb7c9a7c044468e353ee1840b9679` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:52.646718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] RBAC: Authorizing `identity:get_project(project_id=a7cbb7c9a7c044468e353ee1840b9679)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:52.648865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:52.650711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 693/1382] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:10:52 2021] GET /identity/v3/projects/a7cbb7c9a7c044468e353ee1840b9679 => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:52.661405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961673ff-5b28-422b-a8e3-472e425b48f3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:52.671972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961673ff-5b28-422b-a8e3-472e425b48f3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:52.677734 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:52.678519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:52.678799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:52.679055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:52.679844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] RBAC: Adding query filter params (scope.project.id=a7cbb7c9a7c044468e353ee1840b9679) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:10:52.680145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:52.682049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:52.691082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 690/1383] 10.222.0.31 () {56 vars in 1231 bytes} [Tue Nov 16 03:10:52 2021] GET /identity/v3/role_assignments?scope.project.id=a7cbb7c9a7c044468e353ee1840b9679 => generated 877 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:52.698206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:52.709583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef7b21-b6ec-483d-b18b-1b7574bb2bf3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:52.714832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd401-5bd3-4a38-9157-e098ccd6d753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:52.715733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd401-5bd3-4a38-9157-e098ccd6d753 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:52.716011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd401-5bd3-4a38-9157-e098ccd6d753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:52.716280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd401-5bd3-4a38-9157-e098ccd6d753 admin admin] PATH_INFO: `/v3/users/6968a0a3ff794e22946a23b0f7241c3b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:52.732798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bd401-5bd3-4a38-9157-e098ccd6d753 admin admin] RBAC: Authorizing `identity:get_user(user_id=6968a0a3ff794e22946a23b0f7241c3b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:52.735001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bd401-5bd3-4a38-9157-e098ccd6d753 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:52.736807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 694/1384] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:52 2021] GET /identity/v3/users/6968a0a3ff794e22946a23b0f7241c3b => generated 285 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:52.744888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:52.755730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fdd7a-64b5-4ddf-8f9d-fb0d4e63c1b0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:52.765153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c79098-89f4-4c13-9895-cf83a253d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:52.766054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79098-89f4-4c13-9895-cf83a253d517 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:52.766333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79098-89f4-4c13-9895-cf83a253d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:52.766612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c79098-89f4-4c13-9895-cf83a253d517 admin admin] PATH_INFO: `/v3/users/33fe01bc6fae4e289463ec8d5827818d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:52.782644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c79098-89f4-4c13-9895-cf83a253d517 admin admin] RBAC: Authorizing `identity:get_user(user_id=33fe01bc6fae4e289463ec8d5827818d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:52.785153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c79098-89f4-4c13-9895-cf83a253d517 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:52.787070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 691/1385] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:52 2021] GET /identity/v3/users/33fe01bc6fae4e289463ec8d5827818d => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:55.241186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632c85-3b9c-468e-955d-db378d820c5f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:55.242102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632c85-3b9c-468e-955d-db378d820c5f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:55.242102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71632c85-3b9c-468e-955d-db378d820c5f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:55.243551 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 695/1386] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:55.251078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf9d7-3dda-4e3a-b424-24ce9e7e28a3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:55.251634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf9d7-3dda-4e3a-b424-24ce9e7e28a3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:55.251634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cf9d7-3dda-4e3a-b424-24ce9e7e28a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:55.270944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3c6cf9d7-3dda-4e3a-b424-24ce9e7e28a3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:55.272601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3c6cf9d7-3dda-4e3a-b424-24ce9e7e28a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:55.281606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 692/1387] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:55.306203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71632c85-3b9c-468e-955d-db378d820c5f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:55.319854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71632c85-3b9c-468e-955d-db378d820c5f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:55.325284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:55.326182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:55.326466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:55.326738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] PATH_INFO: `/v3/projects/b31d576dc1e4402ab7e6d6363dda4887` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:55.338645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] RBAC: Authorizing `identity:get_project(project_id=b31d576dc1e4402ab7e6d6363dda4887)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:55.340742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:55.342573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 696/1388] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:10:55 2021] GET /identity/v3/projects/b31d576dc1e4402ab7e6d6363dda4887 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:55.350049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cf9d7-3dda-4e3a-b424-24ce9e7e28a3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:55.359874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cf9d7-3dda-4e3a-b424-24ce9e7e28a3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:55.365964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:55.366627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:55.366919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:55.367185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:55.367969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] RBAC: Adding query filter params (scope.project.id=b31d576dc1e4402ab7e6d6363dda4887) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:10:55.368273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:55.370159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:55.377531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 693/1389] 10.222.0.31 () {56 vars in 1231 bytes} [Tue Nov 16 03:10:55 2021] GET /identity/v3/role_assignments?scope.project.id=b31d576dc1e4402ab7e6d6363dda4887 => generated 1934 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:10:55.384364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:55.395661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5ff8b-bf03-4d3e-9e68-09ac75766aa2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:55.403041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cd34df-d499-4e6a-94e1-8c2b2b8de49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:55.403926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd34df-d499-4e6a-94e1-8c2b2b8de49d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:55.404205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd34df-d499-4e6a-94e1-8c2b2b8de49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:55.404478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cd34df-d499-4e6a-94e1-8c2b2b8de49d admin admin] PATH_INFO: `/v3/users/f4f214a399b74701a03f29ff4afa0fe5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:55.405796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd34df-d499-4e6a-94e1-8c2b2b8de49d admin admin] RBAC: Authorizing `identity:get_user(user_id=f4f214a399b74701a03f29ff4afa0fe5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:55.407942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cd34df-d499-4e6a-94e1-8c2b2b8de49d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:55.409610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 697/1390] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:55 2021] GET /identity/v3/users/f4f214a399b74701a03f29ff4afa0fe5 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:55.417121 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:55.427455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee3d8e-61b2-4a64-8060-ef8b99b9aeaa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:55.432868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18b7ce-c985-4ed2-ba3c-b3a8262e089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:55.433766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18b7ce-c985-4ed2-ba3c-b3a8262e089b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:55.434071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18b7ce-c985-4ed2-ba3c-b3a8262e089b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:55.434345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18b7ce-c985-4ed2-ba3c-b3a8262e089b admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:55.435571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18b7ce-c985-4ed2-ba3c-b3a8262e089b admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:55.437390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18b7ce-c985-4ed2-ba3c-b3a8262e089b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:55.439051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 694/1391] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:55 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:57.853939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f08654-fbe4-4f1c-8f28-39767867374d None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:57.854538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f08654-fbe4-4f1c-8f28-39767867374d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:57.854538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f08654-fbe4-4f1c-8f28-39767867374d None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:57.856301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 698/1392] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:10:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:10:57.863545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c35a0-3a98-4092-83b5-c4f076971661 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:57.864176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c35a0-3a98-4092-83b5-c4f076971661 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:57.864176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c35a0-3a98-4092-83b5-c4f076971661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:57.885742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e01c35a0-3a98-4092-83b5-c4f076971661 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:10:57.887036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e01c35a0-3a98-4092-83b5-c4f076971661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:10:57.896979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 695/1393] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:10:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:10:57.921959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f08654-fbe4-4f1c-8f28-39767867374d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:57.937644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f08654-fbe4-4f1c-8f28-39767867374d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:57.942860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:57.944062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:57.944342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:57.944601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] PATH_INFO: `/v3/projects/fb897d934c0d40faa98082f63fe4c388` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:57.945975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] RBAC: Authorizing `identity:get_project(project_id=fb897d934c0d40faa98082f63fe4c388)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:57.947795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:57.949568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 699/1394] 10.222.0.31 () {56 vars in 1207 bytes} [Tue Nov 16 03:10:57 2021] GET /identity/v3/projects/fb897d934c0d40faa98082f63fe4c388 => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:57.957026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c35a0-3a98-4092-83b5-c4f076971661 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:57.967496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c35a0-3a98-4092-83b5-c4f076971661 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:57.974243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fb025-3e70-4c32-8bb3-65d67e0542dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:57.975119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb025-3e70-4c32-8bb3-65d67e0542dc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:57.975345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb025-3e70-4c32-8bb3-65d67e0542dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:57.975579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fb025-3e70-4c32-8bb3-65d67e0542dc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:57.976405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fb025-3e70-4c32-8bb3-65d67e0542dc admin admin] RBAC: Adding query filter params (scope.project.id=fb897d934c0d40faa98082f63fe4c388) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:10:57.976779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fb025-3e70-4c32-8bb3-65d67e0542dc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:57.978725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fb025-3e70-4c32-8bb3-65d67e0542dc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:57.986060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 696/1395] 10.222.0.31 () {56 vars in 1231 bytes} [Tue Nov 16 03:10:57 2021] GET /identity/v3/role_assignments?scope.project.id=fb897d934c0d40faa98082f63fe4c388 => generated 879 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:10:57.993575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:10:58.004666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1529f28-e8c7-47c1-800c-d09d776d5a67 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:10:58.010385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ae9d5-8e03-46fc-8641-12078bb08cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:10:58.011290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ae9d5-8e03-46fc-8641-12078bb08cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:10:58.011571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ae9d5-8e03-46fc-8641-12078bb08cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:10:58.011842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ae9d5-8e03-46fc-8641-12078bb08cfe admin admin] PATH_INFO: `/v3/users/a95f866674d64e91af100063311f9b6a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:10:58.013155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ae9d5-8e03-46fc-8641-12078bb08cfe admin admin] RBAC: Authorizing `identity:get_user(user_id=a95f866674d64e91af100063311f9b6a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:10:58.015150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ae9d5-8e03-46fc-8641-12078bb08cfe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:10:58.016943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 700/1396] 10.222.0.31 () {56 vars in 1198 bytes} [Tue Nov 16 03:10:57 2021] GET /identity/v3/users/a95f866674d64e91af100063311f9b6a => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:11:03.345529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083512b3-5ec6-41b1-a055-06d6ad811395 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:03.346156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083512b3-5ec6-41b1-a055-06d6ad811395 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:03.346156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083512b3-5ec6-41b1-a055-06d6ad811395 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:03.347935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 697/1397] 10.222.0.31 () {54 vars in 918 bytes} [Tue Nov 16 03:11:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:03.354708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e1394-08f0-41ee-9fc0-70e498ef2b53 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:03.355205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e1394-08f0-41ee-9fc0-70e498ef2b53 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:03.355314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e1394-08f0-41ee-9fc0-70e498ef2b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:03.375809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-073e1394-08f0-41ee-9fc0-70e498ef2b53 None None] MFA Rules not processed for user `4ef0f0386b384a09a87bcce51d172598`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:03.377047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-073e1394-08f0-41ee-9fc0-70e498ef2b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:03.387350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 701/1398] 10.222.0.31 () {58 vars in 1015 bytes} [Tue Nov 16 03:11:03 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:03.403910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669adc6d-4811-4e41-922c-ed4305b5a7e5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:03.404195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669adc6d-4811-4e41-922c-ed4305b5a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:03.404472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669adc6d-4811-4e41-922c-ed4305b5a7e5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:03.406332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 698/1399] 10.222.0.31 () {54 vars in 918 bytes} [Tue Nov 16 03:11:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:03.412577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb600a-9b59-4fa2-86bf-a27199aad488 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:03.412888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb600a-9b59-4fa2-86bf-a27199aad488 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:03.413161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb600a-9b59-4fa2-86bf-a27199aad488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:03.431962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e3cb600a-9b59-4fa2-86bf-a27199aad488 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:03.433151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e3cb600a-9b59-4fa2-86bf-a27199aad488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:03.443879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 702/1400] 10.222.0.31 () {58 vars in 1015 bytes} [Tue Nov 16 03:11:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:06.269172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376904f9-a6b9-4538-b785-a82375f59931 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:06.269878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376904f9-a6b9-4538-b785-a82375f59931 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:06.269878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376904f9-a6b9-4538-b785-a82375f59931 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:06.271642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 699/1401] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:06.278228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934906-e863-4347-ba82-653ec4126155 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:06.278715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934906-e863-4347-ba82-653ec4126155 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:06.278823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa934906-e863-4347-ba82-653ec4126155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:06.298342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fa934906-e863-4347-ba82-653ec4126155 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:06.299546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fa934906-e863-4347-ba82-653ec4126155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:06.308825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 703/1402] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:06.353189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376904f9-a6b9-4538-b785-a82375f59931 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:06.369819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376904f9-a6b9-4538-b785-a82375f59931 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:06.375923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36ca88-b66e-45ba-b5bb-c3c4c2bf9bba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:06.376564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ca88-b66e-45ba-b5bb-c3c4c2bf9bba service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:06.376848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ca88-b66e-45ba-b5bb-c3c4c2bf9bba service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:06.377221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36ca88-b66e-45ba-b5bb-c3c4c2bf9bba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:06.386328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36ca88-b66e-45ba-b5bb-c3c4c2bf9bba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:06.387923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36ca88-b66e-45ba-b5bb-c3c4c2bf9bba service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:06.398759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 700/1403] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:07.953234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16d3c-f621-4dd4-9d09-a1228508f8ba None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:07.953891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16d3c-f621-4dd4-9d09-a1228508f8ba None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:07.953891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e16d3c-f621-4dd4-9d09-a1228508f8ba None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:07.955694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 704/1404] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:07.962081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295c626-f3d3-4d77-ae99-337a5540e436 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:07.962585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295c626-f3d3-4d77-ae99-337a5540e436 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:07.962694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295c626-f3d3-4d77-ae99-337a5540e436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:07.983314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c295c626-f3d3-4d77-ae99-337a5540e436 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:07.984535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c295c626-f3d3-4d77-ae99-337a5540e436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:07.993591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 701/1405] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:08.146512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16d3c-f621-4dd4-9d09-a1228508f8ba None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:08.163479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e16d3c-f621-4dd4-9d09-a1228508f8ba None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:08.169467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4276e-0879-4639-af30-786a457e41e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:08.170129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4276e-0879-4639-af30-786a457e41e8 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:08.170408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4276e-0879-4639-af30-786a457e41e8 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:08.170672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4276e-0879-4639-af30-786a457e41e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:08.179402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4276e-0879-4639-af30-786a457e41e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:08.181021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4276e-0879-4639-af30-786a457e41e8 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:08.190414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 705/1406] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:09.662928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce07aa-35ea-4272-9a8e-5345b309cca5 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:09.663535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce07aa-35ea-4272-9a8e-5345b309cca5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:09.663535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce07aa-35ea-4272-9a8e-5345b309cca5 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:09.665259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 702/1407] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:09.671202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376e444-0577-4f7e-b6de-29319676fefa None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:09.671689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376e444-0577-4f7e-b6de-29319676fefa None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:09.671810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376e444-0577-4f7e-b6de-29319676fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:09.690730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3376e444-0577-4f7e-b6de-29319676fefa None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:09.691925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3376e444-0577-4f7e-b6de-29319676fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:09.701144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 706/1408] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:09.858368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce07aa-35ea-4272-9a8e-5345b309cca5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:09.876930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce07aa-35ea-4272-9a8e-5345b309cca5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:09.883283 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2da3a-be2d-489b-a8d7-854d8522d3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:09.883925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2da3a-be2d-489b-a8d7-854d8522d3ee service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:09.884198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2da3a-be2d-489b-a8d7-854d8522d3ee service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:09.884467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2da3a-be2d-489b-a8d7-854d8522d3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:09.894367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2da3a-be2d-489b-a8d7-854d8522d3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:09.896301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2da3a-be2d-489b-a8d7-854d8522d3ee service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:09.906158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 703/1409] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:11.403445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67dc1f-e9ec-4370-ac0d-a15d519cd3dc None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:11.404070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67dc1f-e9ec-4370-ac0d-a15d519cd3dc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:11.404070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67dc1f-e9ec-4370-ac0d-a15d519cd3dc None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:11.405895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 707/1410] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:11.412765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0dc5-7bfc-4af5-a6b6-f0da626fbb95 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:11.413258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0dc5-7bfc-4af5-a6b6-f0da626fbb95 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:11.413258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd0dc5-7bfc-4af5-a6b6-f0da626fbb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:11.432659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-11fd0dc5-7bfc-4af5-a6b6-f0da626fbb95 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:11.433919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-11fd0dc5-7bfc-4af5-a6b6-f0da626fbb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:11.443127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 704/1411] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:11.597536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67dc1f-e9ec-4370-ac0d-a15d519cd3dc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:11.612760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67dc1f-e9ec-4370-ac0d-a15d519cd3dc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:11.619060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc19dd-b9af-4251-b032-b7f609d5d6b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:11.619714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc19dd-b9af-4251-b032-b7f609d5d6b4 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:11.619991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc19dd-b9af-4251-b032-b7f609d5d6b4 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:11.620262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc19dd-b9af-4251-b032-b7f609d5d6b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:11.629056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc19dd-b9af-4251-b032-b7f609d5d6b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:11.631157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc19dd-b9af-4251-b032-b7f609d5d6b4 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:11.640794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 708/1412] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:11:13.136867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7af1af-f06b-4d88-8590-b239849d66b9 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:13.137608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7af1af-f06b-4d88-8590-b239849d66b9 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:13.137608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7af1af-f06b-4d88-8590-b239849d66b9 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:13.139153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 705/1413] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:13.145209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1b2f4-780b-414e-b5d1-3e7be279a3cc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:13.146041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1b2f4-780b-414e-b5d1-3e7be279a3cc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:13.146041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a1b2f4-780b-414e-b5d1-3e7be279a3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:13.166743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-77a1b2f4-780b-414e-b5d1-3e7be279a3cc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:13.167948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-77a1b2f4-780b-414e-b5d1-3e7be279a3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:13.176319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 709/1414] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:13.326453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7af1af-f06b-4d88-8590-b239849d66b9 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:13.341301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7af1af-f06b-4d88-8590-b239849d66b9 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:13.347807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fddde-88d5-4ff2-85f2-3d1ea03c188a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:13.348484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fddde-88d5-4ff2-85f2-3d1ea03c188a service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:13.348867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fddde-88d5-4ff2-85f2-3d1ea03c188a service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:13.349141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fddde-88d5-4ff2-85f2-3d1ea03c188a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:13.358667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fddde-88d5-4ff2-85f2-3d1ea03c188a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:13.360285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fddde-88d5-4ff2-85f2-3d1ea03c188a service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:13.370368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 706/1415] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:14.777350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794aaa4-0b4e-47aa-828a-d113eb49a353 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:14.778290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794aaa4-0b4e-47aa-828a-d113eb49a353 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:14.778290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794aaa4-0b4e-47aa-828a-d113eb49a353 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:14.779739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 710/1416] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:14.786082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915780e-9ace-4d33-9f83-92ec12c372e8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:14.786586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915780e-9ace-4d33-9f83-92ec12c372e8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:14.786586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915780e-9ace-4d33-9f83-92ec12c372e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:14.804760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9915780e-9ace-4d33-9f83-92ec12c372e8 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:14.805988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9915780e-9ace-4d33-9f83-92ec12c372e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:14.815501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 707/1417] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:14.973351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794aaa4-0b4e-47aa-828a-d113eb49a353 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:14.989402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794aaa4-0b4e-47aa-828a-d113eb49a353 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:14.995754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca82556-9742-43fb-a57e-1dd71aa6f51b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:14.996396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca82556-9742-43fb-a57e-1dd71aa6f51b service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:14.996673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca82556-9742-43fb-a57e-1dd71aa6f51b service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:14.996941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca82556-9742-43fb-a57e-1dd71aa6f51b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:15.005894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca82556-9742-43fb-a57e-1dd71aa6f51b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:15.007510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca82556-9742-43fb-a57e-1dd71aa6f51b service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:15.017480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 711/1418] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:16.428546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9888ce-57f7-464d-bcad-660d19d03c07 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:16.429885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9888ce-57f7-464d-bcad-660d19d03c07 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:16.429885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9888ce-57f7-464d-bcad-660d19d03c07 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:16.431876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 708/1419] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:16.438878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493591c-a3e1-45e2-990d-da7cf83b518b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:16.440372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493591c-a3e1-45e2-990d-da7cf83b518b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:16.440372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493591c-a3e1-45e2-990d-da7cf83b518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:16.458937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9493591c-a3e1-45e2-990d-da7cf83b518b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:16.460138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9493591c-a3e1-45e2-990d-da7cf83b518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:16.468474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 712/1420] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:16.620478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9888ce-57f7-464d-bcad-660d19d03c07 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:16.637212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9888ce-57f7-464d-bcad-660d19d03c07 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:16.644026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257610-ea2d-4477-b62b-ca9f468ed0d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:16.644679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257610-ea2d-4477-b62b-ca9f468ed0d2 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:16.644960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257610-ea2d-4477-b62b-ca9f468ed0d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:16.645239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257610-ea2d-4477-b62b-ca9f468ed0d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:16.655190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257610-ea2d-4477-b62b-ca9f468ed0d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:16.656827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257610-ea2d-4477-b62b-ca9f468ed0d2 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:16.668619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 709/1421] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:18.088884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b08b97-1289-45c3-a83a-1366881bd980 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:18.089593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b08b97-1289-45c3-a83a-1366881bd980 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:18.089593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b08b97-1289-45c3-a83a-1366881bd980 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:18.091360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 713/1422] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:18.097893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9998033-c8fc-481c-a0a3-0f6c126028a4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:18.098414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9998033-c8fc-481c-a0a3-0f6c126028a4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:18.098542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9998033-c8fc-481c-a0a3-0f6c126028a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:18.117285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e9998033-c8fc-481c-a0a3-0f6c126028a4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:18.118532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e9998033-c8fc-481c-a0a3-0f6c126028a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:18.127324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 710/1423] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:18.282483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b08b97-1289-45c3-a83a-1366881bd980 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:18.298148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b08b97-1289-45c3-a83a-1366881bd980 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:18.304092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d6a0c-2d77-4b98-8091-51b59cbde282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:18.304728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6a0c-2d77-4b98-8091-51b59cbde282 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:18.305006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6a0c-2d77-4b98-8091-51b59cbde282 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:18.305274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d6a0c-2d77-4b98-8091-51b59cbde282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:18.314015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d6a0c-2d77-4b98-8091-51b59cbde282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:18.315616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d6a0c-2d77-4b98-8091-51b59cbde282 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:18.325802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 714/1424] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:19.761667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407f330-6379-461a-81f4-b65b7e9c3efa None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:19.762290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407f330-6379-461a-81f4-b65b7e9c3efa None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:19.762290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407f330-6379-461a-81f4-b65b7e9c3efa None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:19.764259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 711/1425] 10.222.0.31 () {54 vars in 911 bytes} [Tue Nov 16 03:11:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:19.770705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c2e3-ea65-4214-ba30-8e096c74bf1c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:19.772217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c2e3-ea65-4214-ba30-8e096c74bf1c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:19.772217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37c2e3-ea65-4214-ba30-8e096c74bf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:19.791631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7a37c2e3-ea65-4214-ba30-8e096c74bf1c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:19.792853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7a37c2e3-ea65-4214-ba30-8e096c74bf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:19.800968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 715/1426] 10.222.0.31 () {58 vars in 1008 bytes} [Tue Nov 16 03:11:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:19.954744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407f330-6379-461a-81f4-b65b7e9c3efa None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:19.969904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407f330-6379-461a-81f4-b65b7e9c3efa None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:19.975676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b5443-c4bf-48ae-b8bf-aadee2518ec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:19.976328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5443-c4bf-48ae-b8bf-aadee2518ec3 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:19.976604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5443-c4bf-48ae-b8bf-aadee2518ec3 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:19.976873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b5443-c4bf-48ae-b8bf-aadee2518ec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:19.985876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b5443-c4bf-48ae-b8bf-aadee2518ec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:19.987500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b5443-c4bf-48ae-b8bf-aadee2518ec3 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:19.997623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 712/1427] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:22.263923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ec372-cfec-4094-9e00-6e09e2bd13f3 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:22.264542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ec372-cfec-4094-9e00-6e09e2bd13f3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:22.264542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ec372-cfec-4094-9e00-6e09e2bd13f3 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:22.266318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 716/1428] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:22.273339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bfad7-5c5d-4e2a-91d6-55fc618dd910 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:22.273958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bfad7-5c5d-4e2a-91d6-55fc618dd910 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:22.274062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bfad7-5c5d-4e2a-91d6-55fc618dd910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:22.294917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8e7bfad7-5c5d-4e2a-91d6-55fc618dd910 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:22.296174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8e7bfad7-5c5d-4e2a-91d6-55fc618dd910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:22.305226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 713/1429] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:22.349877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ec372-cfec-4094-9e00-6e09e2bd13f3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:22.361002 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ec372-cfec-4094-9e00-6e09e2bd13f3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:22.364938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f31ee-0736-4c58-9523-c492f439a51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:22.365595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f31ee-0736-4c58-9523-c492f439a51b service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:22.365868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f31ee-0736-4c58-9523-c492f439a51b service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:22.366131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f31ee-0736-4c58-9523-c492f439a51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:22.375509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f31ee-0736-4c58-9523-c492f439a51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:22.376947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f31ee-0736-4c58-9523-c492f439a51b service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:22.386607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 717/1430] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:24.845461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be746c-df8d-4eb1-9c41-b4722c835a25 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:24.846040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be746c-df8d-4eb1-9c41-b4722c835a25 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:24.846040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be746c-df8d-4eb1-9c41-b4722c835a25 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:24.847961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 714/1431] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:24.855635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8312-fdfd-4d72-b1f3-65c71bba1f14 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:24.856193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8312-fdfd-4d72-b1f3-65c71bba1f14 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:24.856193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a8312-fdfd-4d72-b1f3-65c71bba1f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:24.875449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-113a8312-fdfd-4d72-b1f3-65c71bba1f14 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:24.876678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-113a8312-fdfd-4d72-b1f3-65c71bba1f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:24.886766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 718/1432] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:11:24.926879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be746c-df8d-4eb1-9c41-b4722c835a25 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:24.938949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be746c-df8d-4eb1-9c41-b4722c835a25 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:24.943197 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44549ee4-e86e-4ba6-847e-629d9b83827f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:24.943804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44549ee4-e86e-4ba6-847e-629d9b83827f service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:24.944079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44549ee4-e86e-4ba6-847e-629d9b83827f service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:24.944348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44549ee4-e86e-4ba6-847e-629d9b83827f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:24.954761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44549ee4-e86e-4ba6-847e-629d9b83827f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:24.956219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44549ee4-e86e-4ba6-847e-629d9b83827f service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:24.966638 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 715/1433] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:27.564740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24186-d53d-4de3-9c84-f96e1c1df99a None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:27.565717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24186-d53d-4de3-9c84-f96e1c1df99a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:27.565717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad24186-d53d-4de3-9c84-f96e1c1df99a None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:27.568643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 719/1434] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:27.575334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a341a35-1210-417b-879d-7a9f33d3a527 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:27.575854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a341a35-1210-417b-879d-7a9f33d3a527 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:27.575854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a341a35-1210-417b-879d-7a9f33d3a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:27.594907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8a341a35-1210-417b-879d-7a9f33d3a527 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:27.596105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8a341a35-1210-417b-879d-7a9f33d3a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:27.605267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 716/1435] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:27.646783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24186-d53d-4de3-9c84-f96e1c1df99a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:27.658881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad24186-d53d-4de3-9c84-f96e1c1df99a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:27.663725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bddb4e-4c70-44bc-bc90-1d9138faa4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:27.664364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddb4e-4c70-44bc-bc90-1d9138faa4db service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:27.664648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddb4e-4c70-44bc-bc90-1d9138faa4db service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:27.664917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bddb4e-4c70-44bc-bc90-1d9138faa4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:27.674642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddb4e-4c70-44bc-bc90-1d9138faa4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:27.676094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bddb4e-4c70-44bc-bc90-1d9138faa4db service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:27.686090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 720/1436] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:30.173339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291ac0-f6a5-47bd-9b7c-e874ce6570b3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:30.173937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291ac0-f6a5-47bd-9b7c-e874ce6570b3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:30.173937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291ac0-f6a5-47bd-9b7c-e874ce6570b3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:30.175633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 717/1437] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:30.182566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d939c6-ad67-4b56-b6c3-61a26def6e9b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:30.183058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d939c6-ad67-4b56-b6c3-61a26def6e9b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:30.183058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d939c6-ad67-4b56-b6c3-61a26def6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:30.202001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c2d939c6-ad67-4b56-b6c3-61a26def6e9b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:30.203195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c2d939c6-ad67-4b56-b6c3-61a26def6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:30.212326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 721/1438] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:30.251750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291ac0-f6a5-47bd-9b7c-e874ce6570b3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:30.264392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291ac0-f6a5-47bd-9b7c-e874ce6570b3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:30.268652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b382a-ec69-4d97-96a0-78f86c755ea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:30.269293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b382a-ec69-4d97-96a0-78f86c755ea2 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:30.269597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b382a-ec69-4d97-96a0-78f86c755ea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:30.269921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b382a-ec69-4d97-96a0-78f86c755ea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:30.279325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b382a-ec69-4d97-96a0-78f86c755ea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:30.280886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b382a-ec69-4d97-96a0-78f86c755ea2 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:30.290828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 718/1439] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:32.739503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc67b-87e2-49c4-953b-5ec44e92d288 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:32.740106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc67b-87e2-49c4-953b-5ec44e92d288 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:32.740106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bc67b-87e2-49c4-953b-5ec44e92d288 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:32.742100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 722/1440] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:32.748589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07e87-c74c-48b7-b99e-b596ba3aa4f6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:32.749143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07e87-c74c-48b7-b99e-b596ba3aa4f6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:32.749278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be07e87-c74c-48b7-b99e-b596ba3aa4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:32.770574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4be07e87-c74c-48b7-b99e-b596ba3aa4f6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:32.771923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4be07e87-c74c-48b7-b99e-b596ba3aa4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:32.780552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 719/1441] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:11:32.821143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bc67b-87e2-49c4-953b-5ec44e92d288 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:32.833890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bc67b-87e2-49c4-953b-5ec44e92d288 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:32.837842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd5810-f4ad-432b-85ad-84ac86bc67de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:32.838515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd5810-f4ad-432b-85ad-84ac86bc67de service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:32.838795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd5810-f4ad-432b-85ad-84ac86bc67de service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:32.839063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd5810-f4ad-432b-85ad-84ac86bc67de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:32.848799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd5810-f4ad-432b-85ad-84ac86bc67de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:32.850302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd5810-f4ad-432b-85ad-84ac86bc67de service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:32.860048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 723/1442] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:35.246087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a98a2-6d42-41aa-a3ac-e2aefe30be6b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:35.246669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a98a2-6d42-41aa-a3ac-e2aefe30be6b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:35.246669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a98a2-6d42-41aa-a3ac-e2aefe30be6b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:35.248526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 720/1443] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:35.255357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c18aa3-7162-40f4-abd4-0eb4c58dd114 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:35.255828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c18aa3-7162-40f4-abd4-0eb4c58dd114 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:35.255938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c18aa3-7162-40f4-abd4-0eb4c58dd114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:35.274456 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a1c18aa3-7162-40f4-abd4-0eb4c58dd114 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:35.275659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a1c18aa3-7162-40f4-abd4-0eb4c58dd114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:35.283647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 724/1444] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:35.323574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a98a2-6d42-41aa-a3ac-e2aefe30be6b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:35.338476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a98a2-6d42-41aa-a3ac-e2aefe30be6b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:35.343414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a109f33-8e70-4896-afb9-c72e3180f9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:35.344063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109f33-8e70-4896-afb9-c72e3180f9ef service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:35.344345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109f33-8e70-4896-afb9-c72e3180f9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:35.344629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a109f33-8e70-4896-afb9-c72e3180f9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:35.354585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a109f33-8e70-4896-afb9-c72e3180f9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:35.356109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a109f33-8e70-4896-afb9-c72e3180f9ef service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:35.366010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 721/1445] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:37.973112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d14f7-7731-4d4e-9a6b-23a1a00591bd None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:37.973780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d14f7-7731-4d4e-9a6b-23a1a00591bd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:37.973780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d14f7-7731-4d4e-9a6b-23a1a00591bd None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:37.975577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 725/1446] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:37.984035 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abb54c-cf2a-4f4c-a927-e01512857979 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:37.984620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abb54c-cf2a-4f4c-a927-e01512857979 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:37.985037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abb54c-cf2a-4f4c-a927-e01512857979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:38.005184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-66abb54c-cf2a-4f4c-a927-e01512857979 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:38.006447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-66abb54c-cf2a-4f4c-a927-e01512857979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:38.014259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 722/1447] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:38.055611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d14f7-7731-4d4e-9a6b-23a1a00591bd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:38.067598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d14f7-7731-4d4e-9a6b-23a1a00591bd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:38.071736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f4cf4-d963-4848-b5f3-78e6ce9322f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:38.072382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f4cf4-d963-4848-b5f3-78e6ce9322f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:38.072664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f4cf4-d963-4848-b5f3-78e6ce9322f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:38.072961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f4cf4-d963-4848-b5f3-78e6ce9322f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:38.083282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f4cf4-d963-4848-b5f3-78e6ce9322f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:38.084662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f4cf4-d963-4848-b5f3-78e6ce9322f0 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:38.094889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 726/1448] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:40.475256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15988175-4dde-4b08-84a3-726bf0b24e69 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:40.475872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15988175-4dde-4b08-84a3-726bf0b24e69 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:40.475872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15988175-4dde-4b08-84a3-726bf0b24e69 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:40.477739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 723/1449] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:40.484428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5c58d-7d13-471b-9027-2c6b9d5e60b9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:40.484918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5c58d-7d13-471b-9027-2c6b9d5e60b9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:40.485043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5c58d-7d13-471b-9027-2c6b9d5e60b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:40.504844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a7e5c58d-7d13-471b-9027-2c6b9d5e60b9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:40.506097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a7e5c58d-7d13-471b-9027-2c6b9d5e60b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:40.515529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 727/1450] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:40.555555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15988175-4dde-4b08-84a3-726bf0b24e69 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:40.568135 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15988175-4dde-4b08-84a3-726bf0b24e69 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:40.572762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f685115-816c-429e-a929-6efe8d4e7bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:40.573459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685115-816c-429e-a929-6efe8d4e7bba service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:40.573737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685115-816c-429e-a929-6efe8d4e7bba service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:40.574007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f685115-816c-429e-a929-6efe8d4e7bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:40.585537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f685115-816c-429e-a929-6efe8d4e7bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:40.587014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f685115-816c-429e-a929-6efe8d4e7bba service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:40.596982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 724/1451] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:42.994642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c882-a68a-4fb1-9c0e-a1635c5264cb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:42.995261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c882-a68a-4fb1-9c0e-a1635c5264cb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:42.995261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c882-a68a-4fb1-9c0e-a1635c5264cb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:42.997076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 728/1452] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:43.004043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f427f-0f63-49a6-9033-c08b420f4778 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:43.004612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f427f-0f63-49a6-9033-c08b420f4778 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:43.004777 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f427f-0f63-49a6-9033-c08b420f4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:43.024337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-391f427f-0f63-49a6-9033-c08b420f4778 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:43.025599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-391f427f-0f63-49a6-9033-c08b420f4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:43.033814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 725/1453] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:43.074188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c882-a68a-4fb1-9c0e-a1635c5264cb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:43.085254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c882-a68a-4fb1-9c0e-a1635c5264cb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:43.088942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89967942-e428-4200-99c9-b662811360f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:43.089623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967942-e428-4200-99c9-b662811360f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:43.089899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967942-e428-4200-99c9-b662811360f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:43.090170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89967942-e428-4200-99c9-b662811360f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:43.101231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89967942-e428-4200-99c9-b662811360f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:43.102716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89967942-e428-4200-99c9-b662811360f8 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:43.112454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 729/1454] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:11:45.468782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1e45-7863-475d-8275-590a2d0f42b2 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:45.469403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1e45-7863-475d-8275-590a2d0f42b2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:45.469403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1e45-7863-475d-8275-590a2d0f42b2 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:45.471253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 726/1455] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:11:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:11:45.477621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671ea5-3030-41ea-bf6f-52f76f7d5d1c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:45.478120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671ea5-3030-41ea-bf6f-52f76f7d5d1c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:45.478237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60671ea5-3030-41ea-bf6f-52f76f7d5d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:45.497023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-60671ea5-3030-41ea-bf6f-52f76f7d5d1c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:11:45.498317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-60671ea5-3030-41ea-bf6f-52f76f7d5d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:11:45.508001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 730/1456] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:11:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:11:45.547630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1e45-7863-475d-8275-590a2d0f42b2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:11:45.559498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1e45-7863-475d-8275-590a2d0f42b2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:11:45.563585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26be1dfb-374b-42ff-8f96-39f3c7fb9033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:11:45.564238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1dfb-374b-42ff-8f96-39f3c7fb9033 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:11:45.564519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1dfb-374b-42ff-8f96-39f3c7fb9033 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:11:45.564792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be1dfb-374b-42ff-8f96-39f3c7fb9033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:11:45.574872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be1dfb-374b-42ff-8f96-39f3c7fb9033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:11:45.576305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26be1dfb-374b-42ff-8f96-39f3c7fb9033 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:11:45.586716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 727/1457] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:11:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:12:02.630107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6380ed-08d4-4051-a244-73462b919850 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:02.630755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6380ed-08d4-4051-a244-73462b919850 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:02.630755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6380ed-08d4-4051-a244-73462b919850 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:02.632493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 731/1458] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:12:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:02.639214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82ecf-29f3-4e77-82ca-96ea9a0f46e2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:02.639707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82ecf-29f3-4e77-82ca-96ea9a0f46e2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:02.639840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82ecf-29f3-4e77-82ca-96ea9a0f46e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:02.660199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b4c82ecf-29f3-4e77-82ca-96ea9a0f46e2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:02.662188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b4c82ecf-29f3-4e77-82ca-96ea9a0f46e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:02.671555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 728/1459] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:12:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:12:02.721288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3a367-b297-4299-be75-f69621900ae8 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:02.721607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3a367-b297-4299-be75-f69621900ae8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:02.721912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3a367-b297-4299-be75-f69621900ae8 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:02.724201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 732/1460] 10.222.0.31 () {54 vars in 962 bytes} [Tue Nov 16 03:12:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:02.729945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6e83-0452-4eb2-b7f8-73a97d033363 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:02.730234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6e83-0452-4eb2-b7f8-73a97d033363 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:02.730511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f6e83-0452-4eb2-b7f8-73a97d033363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:02.749484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-645f6e83-0452-4eb2-b7f8-73a97d033363 None None] MFA Rules not processed for user `c3fd595065064131926ed83613a82ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:02.750709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-645f6e83-0452-4eb2-b7f8-73a97d033363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:02.758512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 729/1461] 10.222.0.31 () {58 vars in 1059 bytes} [Tue Nov 16 03:12:02 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:12:02.766483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3a367-b297-4299-be75-f69621900ae8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:12:02.778230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3a367-b297-4299-be75-f69621900ae8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:12:02.782010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae796b52-620d-4fff-990e-eba71d32c334 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:12:02.782652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796b52-620d-4fff-990e-eba71d32c334 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:02.782929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796b52-620d-4fff-990e-eba71d32c334 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:02.783201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae796b52-620d-4fff-990e-eba71d32c334 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:02.794471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae796b52-620d-4fff-990e-eba71d32c334 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:12:02.796173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae796b52-620d-4fff-990e-eba71d32c334 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:12:02.807796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 733/1462] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:12:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:12:05.250709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc4919-fc9b-47bb-be7f-4f3bb92caa6a None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:05.251292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc4919-fc9b-47bb-be7f-4f3bb92caa6a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:05.251292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc4919-fc9b-47bb-be7f-4f3bb92caa6a None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:05.253138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 730/1463] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:12:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:05.259801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8649-b339-43ed-92d5-686dc818bb4e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:05.260244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8649-b339-43ed-92d5-686dc818bb4e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:05.260398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e8649-b339-43ed-92d5-686dc818bb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:05.279363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e54e8649-b339-43ed-92d5-686dc818bb4e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:05.280555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e54e8649-b339-43ed-92d5-686dc818bb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:05.289392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 734/1464] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:12:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:12:05.314302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc4919-fc9b-47bb-be7f-4f3bb92caa6a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:12:05.327850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc4919-fc9b-47bb-be7f-4f3bb92caa6a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:12:05.333252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf983ff-f90c-4b97-a385-029af6238a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:12:05.333950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf983ff-f90c-4b97-a385-029af6238a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:05.334236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf983ff-f90c-4b97-a385-029af6238a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:05.334517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf983ff-f90c-4b97-a385-029af6238a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:05.335269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf983ff-f90c-4b97-a385-029af6238a5b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:12:05.337147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf983ff-f90c-4b97-a385-029af6238a5b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:12:05.351624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 731/1465] 10.222.0.31 () {56 vars in 1108 bytes} [Tue Nov 16 03:12:05 2021] GET /identity/v3/projects => generated 2553 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:12:07.697347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc288-7131-4f30-84d6-079ea53c34c5 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:07.697931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc288-7131-4f30-84d6-079ea53c34c5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:07.698053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc288-7131-4f30-84d6-079ea53c34c5 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:07.700785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 735/1466] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:12:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:07.707204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a718d33-6d61-4425-8612-00faaee72647 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:07.707713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a718d33-6d61-4425-8612-00faaee72647 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:07.707826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a718d33-6d61-4425-8612-00faaee72647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:07.727811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0a718d33-6d61-4425-8612-00faaee72647 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:07.729036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0a718d33-6d61-4425-8612-00faaee72647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:07.739084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 732/1467] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:12:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:12:07.785633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc288-7131-4f30-84d6-079ea53c34c5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:12:07.801642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc288-7131-4f30-84d6-079ea53c34c5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:12:07.807517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d2171-54ec-44e1-b6f4-f51d601a82bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:12:07.808167 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2171-54ec-44e1-b6f4-f51d601a82bf service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:07.808445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2171-54ec-44e1-b6f4-f51d601a82bf service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:07.808714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d2171-54ec-44e1-b6f4-f51d601a82bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:07.817875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d2171-54ec-44e1-b6f4-f51d601a82bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:12:07.819524 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d2171-54ec-44e1-b6f4-f51d601a82bf service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:12:07.829523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 736/1468] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:12:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:12:10.373460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d374e12-6ce4-4d16-bd7b-42533ad1289e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:10.374058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d374e12-6ce4-4d16-bd7b-42533ad1289e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:10.374058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d374e12-6ce4-4d16-bd7b-42533ad1289e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:10.375818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 733/1469] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:12:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:10.382462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b764-469b-4f81-9d75-7daf18e602de None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:10.382995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b764-469b-4f81-9d75-7daf18e602de None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:10.382995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04b764-469b-4f81-9d75-7daf18e602de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:10.402561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6c04b764-469b-4f81-9d75-7daf18e602de None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:10.403829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6c04b764-469b-4f81-9d75-7daf18e602de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:10.413532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 737/1470] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:12:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:12:10.451604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d374e12-6ce4-4d16-bd7b-42533ad1289e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:12:10.464871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d374e12-6ce4-4d16-bd7b-42533ad1289e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:12:10.468539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781e334-d84a-449d-b2aa-e16823736f38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:12:10.469192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e334-d84a-449d-b2aa-e16823736f38 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:10.469501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e334-d84a-449d-b2aa-e16823736f38 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:10.469781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781e334-d84a-449d-b2aa-e16823736f38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:10.479615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781e334-d84a-449d-b2aa-e16823736f38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:12:10.481098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781e334-d84a-449d-b2aa-e16823736f38 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:12:10.490720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 734/1471] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:12:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:12:12.891204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902793-1e38-4e67-a409-5497eaa2b67f None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:12.891991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902793-1e38-4e67-a409-5497eaa2b67f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:12.891991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902793-1e38-4e67-a409-5497eaa2b67f None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:12.895007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 738/1472] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:12:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:12.902456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea378-8eed-4d28-80cd-523a8b998ad5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:12.903039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea378-8eed-4d28-80cd-523a8b998ad5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:12.903039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affea378-8eed-4d28-80cd-523a8b998ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:12.924778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-affea378-8eed-4d28-80cd-523a8b998ad5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:12.926319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-affea378-8eed-4d28-80cd-523a8b998ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:12.934803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 735/1473] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:12:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:12:12.977244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11902793-1e38-4e67-a409-5497eaa2b67f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:12:12.991413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11902793-1e38-4e67-a409-5497eaa2b67f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:12:12.995349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f696cd-879c-48f2-bf18-e3a16413e98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:12:12.996014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f696cd-879c-48f2-bf18-e3a16413e98b service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:12.996294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f696cd-879c-48f2-bf18-e3a16413e98b service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:12.996565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f696cd-879c-48f2-bf18-e3a16413e98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:13.008260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f696cd-879c-48f2-bf18-e3a16413e98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:12:13.009840 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f696cd-879c-48f2-bf18-e3a16413e98b service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:12:13.020602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 739/1474] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:12:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:12:15.545012 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833b85-626b-42a0-ab6e-17027bc0133a None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:15.545635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833b85-626b-42a0-ab6e-17027bc0133a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:15.545635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833b85-626b-42a0-ab6e-17027bc0133a None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:15.548352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 736/1475] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:12:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:15.557351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e3951-addc-4298-84cf-8638bd36dce5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:15.557889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e3951-addc-4298-84cf-8638bd36dce5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:15.558096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e3951-addc-4298-84cf-8638bd36dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:15.580343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c11e3951-addc-4298-84cf-8638bd36dce5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:15.581606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c11e3951-addc-4298-84cf-8638bd36dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:15.589800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 740/1476] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:12:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:12:15.634853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3833b85-626b-42a0-ab6e-17027bc0133a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:12:15.646418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3833b85-626b-42a0-ab6e-17027bc0133a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:12:15.650748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d44b5-ae26-4a32-aa5d-0dca3f8190a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:12:15.652604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d44b5-ae26-4a32-aa5d-0dca3f8190a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:15.652887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d44b5-ae26-4a32-aa5d-0dca3f8190a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:15.653161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d44b5-ae26-4a32-aa5d-0dca3f8190a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:15.664105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d44b5-ae26-4a32-aa5d-0dca3f8190a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:12:15.665882 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d44b5-ae26-4a32-aa5d-0dca3f8190a3 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:12:15.679017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 737/1477] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:12:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:12:18.325004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0017-b3f2-4be3-a4b6-aa3a1a4aa425 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:18.325609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0017-b3f2-4be3-a4b6-aa3a1a4aa425 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:18.325609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda0017-b3f2-4be3-a4b6-aa3a1a4aa425 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:18.327429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 741/1478] 10.222.0.31 () {54 vars in 926 bytes} [Tue Nov 16 03:12:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:12:18.334255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275054d5-3eed-464f-86fd-516034d3f40f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:18.334763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275054d5-3eed-464f-86fd-516034d3f40f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:18.334763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275054d5-3eed-464f-86fd-516034d3f40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:18.353247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-275054d5-3eed-464f-86fd-516034d3f40f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:12:18.354485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-275054d5-3eed-464f-86fd-516034d3f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:12:18.363019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 738/1479] 10.222.0.31 () {58 vars in 1023 bytes} [Tue Nov 16 03:12:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:12:18.404548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda0017-b3f2-4be3-a4b6-aa3a1a4aa425 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:12:18.417449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda0017-b3f2-4be3-a4b6-aa3a1a4aa425 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:12:18.421648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f1610-3195-47c2-9e00-17eace492cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:12:18.422327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1610-3195-47c2-9e00-17eace492cca service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:12:18.422627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1610-3195-47c2-9e00-17eace492cca service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:12:18.422890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1610-3195-47c2-9e00-17eace492cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:12:18.434353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f1610-3195-47c2-9e00-17eace492cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:12:18.435842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f1610-3195-47c2-9e00-17eace492cca service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:12:18.445846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 742/1480] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:12:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:13:31.119067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27730-9a20-4ee3-b302-f34082cc868e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.119688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27730-9a20-4ee3-b302-f34082cc868e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.119688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e27730-9a20-4ee3-b302-f34082cc868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.144262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-21e27730-9a20-4ee3-b302-f34082cc868e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:13:31.145910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-21e27730-9a20-4ee3-b302-f34082cc868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:13:31.154538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 739/1481] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:13:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:13:31.163832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae161-e7e3-4819-a954-dc285b0fe6d9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.164390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae161-e7e3-4819-a954-dc285b0fe6d9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.164390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbae161-e7e3-4819-a954-dc285b0fe6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.184293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1bbae161-e7e3-4819-a954-dc285b0fe6d9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:13:31.185538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1bbae161-e7e3-4819-a954-dc285b0fe6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:13:31.194152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 743/1482] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:13:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:13:31.199169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e27730-9a20-4ee3-b302-f34082cc868e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.213119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e27730-9a20-4ee3-b302-f34082cc868e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.220763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.221477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.221761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.222035 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.222839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:13:31.223145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.224780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:31.238500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 740/1483] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:13:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:13:31.249775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae161-e7e3-4819-a954-dc285b0fe6d9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.260235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbae161-e7e3-4819-a954-dc285b0fe6d9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.266239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.266807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.267095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.267914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.268635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.270618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:31.315950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 744/1484] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:13:31 2021] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:13:31.320978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.333006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b95c7-c84e-4551-ba2c-6b1e7e8becf7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.395935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.396591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.396842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.397155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.397958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.399901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:31.421643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 741/1485] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:13:31 2021] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:13:31.426120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.437206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad1749-567a-4a2f-92e7-d6e80701de75 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.443166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.443862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.444202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.444470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.445216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.446961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:31.466570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 745/1486] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:13:31 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:13:31.470747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.481304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84761-3fab-4608-9186-8aa9e2144fa1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.487845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be019d0d-276b-4f28-a148-52518a7823f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.488530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be019d0d-276b-4f28-a148-52518a7823f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.488812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be019d0d-276b-4f28-a148-52518a7823f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.489079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be019d0d-276b-4f28-a148-52518a7823f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.489865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be019d0d-276b-4f28-a148-52518a7823f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.491643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be019d0d-276b-4f28-a148-52518a7823f5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:31.506729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 742/1487] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:13:31 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:13:31.511514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.522862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890712a4-6472-462e-bb2c-850fd85790b5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.529075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.530936 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.531454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.531880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] PATH_INFO: `/v3/projects/7dd6bfae705743c39d15e3142f8d0e29/users/5fd0cede4a7944f0985082ffae56638e/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.551586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd6bfae705743c39d15e3142f8d0e29, user_id=5fd0cede4a7944f0985082ffae56638e, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.554440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:31.569985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 746/1488] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:13:31 2021] PUT /identity/v3/projects/7dd6bfae705743c39d15e3142f8d0e29/users/5fd0cede4a7944f0985082ffae56638e/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:13:31.582341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5711-f636-465f-91bb-d7b03f63e93d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.582659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5711-f636-465f-91bb-d7b03f63e93d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.582958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b5711-f636-465f-91bb-d7b03f63e93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.614747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f00b5711-f636-465f-91bb-d7b03f63e93d None None] MFA Rules not processed for user `5fd0cede4a7944f0985082ffae56638e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:13:31.616756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f00b5711-f636-465f-91bb-d7b03f63e93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:13:31.688817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 743/1489] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:13:31 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:13:31.705317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.781930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019973d9-a2aa-4ece-af4b-7c01af4fcbb9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.788817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.789530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.789820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.790129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.799198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.800943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:31.813264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 747/1490] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:13:31 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:13:31.887725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d57c-20f3-4ac9-9431-88a59a9614b3 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.888010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d57c-20f3-4ac9-9431-88a59a9614b3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.888286 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d57c-20f3-4ac9-9431-88a59a9614b3 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.890083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 744/1491] 10.222.0.31 () {52 vars in 829 bytes} [Tue Nov 16 03:13:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:13:31.894429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:31.970651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a37556-d730-4434-bef5-b63f074c741e service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:31.976613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:31.977757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:31.978107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:31.978385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] PATH_INFO: `/v3/users/5fd0cede4a7944f0985082ffae56638e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:31.979713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd0cede4a7944f0985082ffae56638e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:31.980739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:13:31.980739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:13:31.980739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:13:31.982014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:32.055854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd0cede4a7944f0985082ffae56638e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.056604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd0cede4a7944f0985082ffae56638e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.070291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd0cede4a7944f0985082ffae56638e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.093111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd0cede4a7944f0985082ffae56638e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.103859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd0cede4a7944f0985082ffae56638e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.110619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 748/1492] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:13:31 2021] DELETE /identity/v3/users/5fd0cede4a7944f0985082ffae56638e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:13:32.115650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:32.115931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:32.116208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:32.136586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:13:32.137862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:13:32.203159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 745/1493] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:13:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:13:32.214889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:32.216372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:13:32.277468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f26b-36ce-4637-86ba-5883182a940f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:32.281097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899c008-1152-47b8-8516-d0b1489738b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:32.281798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c008-1152-47b8-8516-d0b1489738b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:32.282165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c008-1152-47b8-8516-d0b1489738b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:32.282447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899c008-1152-47b8-8516-d0b1489738b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:32.293010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899c008-1152-47b8-8516-d0b1489738b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:32.294503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899c008-1152-47b8-8516-d0b1489738b0 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:32.305086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 749/1494] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:13:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:13:32.694977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:13:32.696750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:13:32.712654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96413bdb-9a4b-4b1d-85dc-4ac7c88cf057 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:13:32.719034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:13:32.719632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:13:32.720772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:13:32.720772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] PATH_INFO: `/v3/projects/7dd6bfae705743c39d15e3142f8d0e29` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:13:32.721984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd6bfae705743c39d15e3142f8d0e29)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:13:32.723194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:13:32.723194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:13:32.723194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:13:32.724119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:13:32.805392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd6bfae705743c39d15e3142f8d0e29', 'request_id': 'req-db31fac1-3ef0-405d-ab1c-c482fa0451a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.822662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd6bfae705743c39d15e3142f8d0e29', 'request_id': 'req-db31fac1-3ef0-405d-ab1c-c482fa0451a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.831061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd6bfae705743c39d15e3142f8d0e29', 'request_id': 'req-db31fac1-3ef0-405d-ab1c-c482fa0451a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.855357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] The token cache is being invalidate because project 7dd6bfae705743c39d15e3142f8d0e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:13:32.855619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.856392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-db31fac1-3ef0-405d-ab1c-c482fa0451a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:13:32.858095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 746/1495] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:13:32 2021] DELETE /identity/v3/projects/7dd6bfae705743c39d15e3142f8d0e29 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:15:00.072974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb10b35-5e1e-4fb5-a855-415d0509a668 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:00.073674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb10b35-5e1e-4fb5-a855-415d0509a668 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:00.073674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb10b35-5e1e-4fb5-a855-415d0509a668 None None] PATH_INFO: `/v3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:00.074850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 750/1496] 10.222.0.11 () {54 vars in 925 bytes} [Tue Nov 16 03:15:00 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:15:00.083608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c98f0a-a69c-4bd1-96e6-739b2edf8eae None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:00.084087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c98f0a-a69c-4bd1-96e6-739b2edf8eae None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:00.084196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c98f0a-a69c-4bd1-96e6-739b2edf8eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:00.103812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d2c98f0a-a69c-4bd1-96e6-739b2edf8eae None None] MFA Rules not processed for user `4ef0f0386b384a09a87bcce51d172598`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:00.105057 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d2c98f0a-a69c-4bd1-96e6-739b2edf8eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:00.170487 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 747/1497] 10.222.0.11 () {58 vars in 1015 bytes} [Tue Nov 16 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:00.703898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415bd73-9f24-4bef-9f30-b13aa458ccde None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:00.704199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415bd73-9f24-4bef-9f30-b13aa458ccde None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:00.704585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415bd73-9f24-4bef-9f30-b13aa458ccde None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:00.707472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 751/1498] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 03:15:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:00.716477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650f610-5160-453a-8f7a-0c10eee070f7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:00.716930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650f610-5160-453a-8f7a-0c10eee070f7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:00.717418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650f610-5160-453a-8f7a-0c10eee070f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:00.738884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8650f610-5160-453a-8f7a-0c10eee070f7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:00.740096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8650f610-5160-453a-8f7a-0c10eee070f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:00.807971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 748/1499] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 03:15:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:00.977978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415bd73-9f24-4bef-9f30-b13aa458ccde None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:00.979929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3415bd73-9f24-4bef-9f30-b13aa458ccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:01.062927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415bd73-9f24-4bef-9f30-b13aa458ccde None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:01.070023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3d514-f00b-4e89-ab07-284208ef08bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:01.070691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3d514-f00b-4e89-ab07-284208ef08bd service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:01.070954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3d514-f00b-4e89-ab07-284208ef08bd service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:01.071253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3d514-f00b-4e89-ab07-284208ef08bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:01.080511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3d514-f00b-4e89-ab07-284208ef08bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:01.082178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3d514-f00b-4e89-ab07-284208ef08bd service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:01.092479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 752/1500] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:02.537817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f59f-f897-4f11-841e-e0b824260fd6 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:02.538466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f59f-f897-4f11-841e-e0b824260fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:02.538466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f59f-f897-4f11-841e-e0b824260fd6 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:02.540178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 749/1501] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 03:15:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:02.546799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb95e-6963-4c83-b564-14a474fe91b6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:02.547576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb95e-6963-4c83-b564-14a474fe91b6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:02.547748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcb95e-6963-4c83-b564-14a474fe91b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:02.568136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-eafcb95e-6963-4c83-b564-14a474fe91b6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:02.569373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-eafcb95e-6963-4c83-b564-14a474fe91b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:02.577724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 753/1502] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 03:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:02.738972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23f59f-f897-4f11-841e-e0b824260fd6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:02.755423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23f59f-f897-4f11-841e-e0b824260fd6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:02.761383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92a2c5-71e8-4c75-bcd6-8b52499cfc63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:02.762062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a2c5-71e8-4c75-bcd6-8b52499cfc63 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:02.762341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a2c5-71e8-4c75-bcd6-8b52499cfc63 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:02.762613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92a2c5-71e8-4c75-bcd6-8b52499cfc63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:02.772729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92a2c5-71e8-4c75-bcd6-8b52499cfc63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:02.774396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d92a2c5-71e8-4c75-bcd6-8b52499cfc63 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:02.785517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 750/1503] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:09.437638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab47f-6f95-45e7-b4ea-73f27055f7fb None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:09.438434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab47f-6f95-45e7-b4ea-73f27055f7fb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:09.438434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab47f-6f95-45e7-b4ea-73f27055f7fb None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:09.439965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 754/1504] 10.222.0.31 () {54 vars in 960 bytes} [Tue Nov 16 03:15:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:09.446227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc3f5e-a5ec-4cbd-8106-01e067fa8212 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:09.446965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc3f5e-a5ec-4cbd-8106-01e067fa8212 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:09.446965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc3f5e-a5ec-4cbd-8106-01e067fa8212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:09.468886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-92cc3f5e-a5ec-4cbd-8106-01e067fa8212 None None] MFA Rules not processed for user `4ef0f0386b384a09a87bcce51d172598`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:09.470090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-92cc3f5e-a5ec-4cbd-8106-01e067fa8212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:09.480201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 751/1505] 10.222.0.31 () {58 vars in 1057 bytes} [Tue Nov 16 03:15:09 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:09.489895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab47f-6f95-45e7-b4ea-73f27055f7fb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:09.510137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab47f-6f95-45e7-b4ea-73f27055f7fb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:09.515981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e172a-89f8-4360-bf8f-12474d2c59cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:09.516627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e172a-89f8-4360-bf8f-12474d2c59cb service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:09.516903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e172a-89f8-4360-bf8f-12474d2c59cb service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:09.517174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e172a-89f8-4360-bf8f-12474d2c59cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:09.526131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e172a-89f8-4360-bf8f-12474d2c59cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:09.527750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e172a-89f8-4360-bf8f-12474d2c59cb service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:09.538078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 755/1506] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:14.647190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5ffa-34ed-4746-9ad4-bfdc110cf2a4 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:14.647755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5ffa-34ed-4746-9ad4-bfdc110cf2a4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:14.647755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5ffa-34ed-4746-9ad4-bfdc110cf2a4 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:14.650464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 752/1507] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 03:15:14 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:14.655918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0032b5-ad78-4239-bafb-65dfee7f17fd None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:14.656410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0032b5-ad78-4239-bafb-65dfee7f17fd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:14.656410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0032b5-ad78-4239-bafb-65dfee7f17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:14.683819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cc0032b5-ad78-4239-bafb-65dfee7f17fd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:14.685039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cc0032b5-ad78-4239-bafb-65dfee7f17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:14.694630 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 756/1508] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 03:15:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:14.847709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5ffa-34ed-4746-9ad4-bfdc110cf2a4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:14.871085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5ffa-34ed-4746-9ad4-bfdc110cf2a4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:14.880592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877056a4-5162-461c-b848-018ce770385e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:14.881246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877056a4-5162-461c-b848-018ce770385e service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:14.881558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877056a4-5162-461c-b848-018ce770385e service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:14.881831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877056a4-5162-461c-b848-018ce770385e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:14.890467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877056a4-5162-461c-b848-018ce770385e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:14.892057 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877056a4-5162-461c-b848-018ce770385e service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:14.901761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 753/1509] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:16.323153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d867126-ea54-45e5-820d-3d86df393b37 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:16.323753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d867126-ea54-45e5-820d-3d86df393b37 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:16.323753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d867126-ea54-45e5-820d-3d86df393b37 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:16.326554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 757/1510] 127.0.0.1 () {54 vars in 901 bytes} [Tue Nov 16 03:15:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:16.336711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7046-eedc-4032-91fe-b4e66264545a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:16.337516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7046-eedc-4032-91fe-b4e66264545a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:16.337704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7046-eedc-4032-91fe-b4e66264545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:16.366207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-757a7046-eedc-4032-91fe-b4e66264545a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:16.367427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-757a7046-eedc-4032-91fe-b4e66264545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:16.376871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 754/1511] 127.0.0.1 () {58 vars in 998 bytes} [Tue Nov 16 03:15:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:16.534600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d867126-ea54-45e5-820d-3d86df393b37 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:16.557626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d867126-ea54-45e5-820d-3d86df393b37 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:16.565311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e7db4-05b0-4746-9b70-aa6b78772bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:16.566110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7db4-05b0-4746-9b70-aa6b78772bab service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:16.566467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7db4-05b0-4746-9b70-aa6b78772bab service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:16.566824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7db4-05b0-4746-9b70-aa6b78772bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:16.576234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e7db4-05b0-4746-9b70-aa6b78772bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:16.577828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e7db4-05b0-4746-9b70-aa6b78772bab service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:16.587214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 758/1512] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:20.783271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b3e65-232e-4952-bdc9-dfb8509f630d None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:20.784022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b3e65-232e-4952-bdc9-dfb8509f630d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:20.784022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b3e65-232e-4952-bdc9-dfb8509f630d None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:20.786037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 755/1513] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 03:15:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:20.793722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5875d-3a00-4b3c-a3fb-5f4d271362ba None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:20.795221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5875d-3a00-4b3c-a3fb-5f4d271362ba None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:20.795221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5875d-3a00-4b3c-a3fb-5f4d271362ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:20.817817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e4c5875d-3a00-4b3c-a3fb-5f4d271362ba None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:20.818742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e4c5875d-3a00-4b3c-a3fb-5f4d271362ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:20.827420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 759/1514] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 03:15:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:20.866969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b3e65-232e-4952-bdc9-dfb8509f630d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:20.869080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a48b3e65-232e-4952-bdc9-dfb8509f630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:20.934926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b3e65-232e-4952-bdc9-dfb8509f630d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:20.938900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb79d20-8df3-4e3a-95df-3942b51d570f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:20.939556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79d20-8df3-4e3a-95df-3942b51d570f service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:20.939840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79d20-8df3-4e3a-95df-3942b51d570f service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:20.940093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79d20-8df3-4e3a-95df-3942b51d570f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:20.950836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb79d20-8df3-4e3a-95df-3942b51d570f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:20.952297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb79d20-8df3-4e3a-95df-3942b51d570f service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:20.965609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 756/1515] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:23.267866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a912-a08b-4b6c-934c-5cb0373c7194 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:23.268451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a912-a08b-4b6c-934c-5cb0373c7194 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:23.268451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8a912-a08b-4b6c-934c-5cb0373c7194 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:23.270265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 760/1516] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 03:15:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:23.276672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be4f4-667a-489f-9ae1-d9c77674cba0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:23.277206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be4f4-667a-489f-9ae1-d9c77674cba0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:23.277206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13be4f4-667a-489f-9ae1-d9c77674cba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:23.297708 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c13be4f4-667a-489f-9ae1-d9c77674cba0 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:23.298931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c13be4f4-667a-489f-9ae1-d9c77674cba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:23.308449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 757/1517] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 03:15:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:23.347146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8a912-a08b-4b6c-934c-5cb0373c7194 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:23.359721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8a912-a08b-4b6c-934c-5cb0373c7194 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:23.363616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7e8b1-c454-4531-92aa-eb7f96da1f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:23.364261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e8b1-c454-4531-92aa-eb7f96da1f62 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:23.364536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e8b1-c454-4531-92aa-eb7f96da1f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:23.364806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7e8b1-c454-4531-92aa-eb7f96da1f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:23.374827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7e8b1-c454-4531-92aa-eb7f96da1f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:23.376279 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7e8b1-c454-4531-92aa-eb7f96da1f62 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:23.388603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 761/1518] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:27.149485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37408dfe-0989-4cfd-9b88-beb8f9593dff None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:27.150050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37408dfe-0989-4cfd-9b88-beb8f9593dff None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:27.150050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37408dfe-0989-4cfd-9b88-beb8f9593dff None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:27.151754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 758/1519] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 03:15:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:27.158184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7084340-aa01-40f0-b76e-d77618c6e887 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:27.158687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7084340-aa01-40f0-b76e-d77618c6e887 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:27.158687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7084340-aa01-40f0-b76e-d77618c6e887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:27.178810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e7084340-aa01-40f0-b76e-d77618c6e887 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:27.180028 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e7084340-aa01-40f0-b76e-d77618c6e887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:27.189243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 762/1520] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 03:15:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:15:27.240190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37408dfe-0989-4cfd-9b88-beb8f9593dff None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:27.242032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-37408dfe-0989-4cfd-9b88-beb8f9593dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:27.311335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37408dfe-0989-4cfd-9b88-beb8f9593dff None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:27.315908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b2344-d53f-49bf-a890-e461c2b3132b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:27.316597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b2344-d53f-49bf-a890-e461c2b3132b service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:27.316883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b2344-d53f-49bf-a890-e461c2b3132b service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:27.317159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b2344-d53f-49bf-a890-e461c2b3132b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:27.328648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b2344-d53f-49bf-a890-e461c2b3132b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:27.330146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b2344-d53f-49bf-a890-e461c2b3132b service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:27.340303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 759/1521] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:15:29.632353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d2ec-38c2-4aac-86a7-e4a5f7396fe2 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:29.632992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d2ec-38c2-4aac-86a7-e4a5f7396fe2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:29.632992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5937d2ec-38c2-4aac-86a7-e4a5f7396fe2 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:29.634826 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 916 bytes} [Tue Nov 16 03:15:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:29.640872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354479e-ccf2-4e7d-83bf-c0da1a89cadd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:29.641348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354479e-ccf2-4e7d-83bf-c0da1a89cadd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:29.641485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354479e-ccf2-4e7d-83bf-c0da1a89cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:29.661186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e354479e-ccf2-4e7d-83bf-c0da1a89cadd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:29.662436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e354479e-ccf2-4e7d-83bf-c0da1a89cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:29.672879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Nov 16 03:15:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:29.724432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15716d-254e-40b0-8914-1b446090cac4 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:29.724690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15716d-254e-40b0-8914-1b446090cac4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:29.724963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15716d-254e-40b0-8914-1b446090cac4 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:29.726785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 764/1524] 10.222.0.31 () {54 vars in 962 bytes} [Tue Nov 16 03:15:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:15:29.732237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563975a-1e00-45fa-b66f-0e02252777a2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:29.732519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563975a-1e00-45fa-b66f-0e02252777a2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:29.732875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563975a-1e00-45fa-b66f-0e02252777a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:29.753005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6563975a-1e00-45fa-b66f-0e02252777a2 None None] MFA Rules not processed for user `2904526cac37478bb9fd712ac29f86f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:15:29.754290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6563975a-1e00-45fa-b66f-0e02252777a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:15:29.762224 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 761/1525] 10.222.0.31 () {58 vars in 1059 bytes} [Tue Nov 16 03:15:29 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:15:29.770505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15716d-254e-40b0-8914-1b446090cac4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:15:29.782410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15716d-254e-40b0-8914-1b446090cac4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:15:29.787296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd51faf-1b5e-4939-9e83-8524fc33c8f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:15:29.787938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd51faf-1b5e-4939-9e83-8524fc33c8f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:15:29.788274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd51faf-1b5e-4939-9e83-8524fc33c8f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:15:29.788494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd51faf-1b5e-4939-9e83-8524fc33c8f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:15:29.798216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd51faf-1b5e-4939-9e83-8524fc33c8f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:15:29.799675 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd51faf-1b5e-4939-9e83-8524fc33c8f5 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:15:29.810084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 765/1526] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:15:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:50.709833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174179-d2ca-4dde-a996-ba4978854b49 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:50.710429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174179-d2ca-4dde-a996-ba4978854b49 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:50.710429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174179-d2ca-4dde-a996-ba4978854b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:50.732496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7a174179-d2ca-4dde-a996-ba4978854b49 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:50.734208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7a174179-d2ca-4dde-a996-ba4978854b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:50.745392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 762/1527] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:50.754619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5be857-8cf2-4692-978e-c1943832d3de None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:50.755192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5be857-8cf2-4692-978e-c1943832d3de None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:50.755192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5be857-8cf2-4692-978e-c1943832d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:50.780107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-fa5be857-8cf2-4692-978e-c1943832d3de None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:50.781451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fa5be857-8cf2-4692-978e-c1943832d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:50.793335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 766/1528] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:50.798044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174179-d2ca-4dde-a996-ba4978854b49 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:50.819391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174179-d2ca-4dde-a996-ba4978854b49 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:50.824867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:50.826030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:50.826658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:50.827169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:50.828816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:50.829341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:50.831203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:50.849199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 763/1529] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:50.857324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5be857-8cf2-4692-978e-c1943832d3de None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:50.873582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5be857-8cf2-4692-978e-c1943832d3de None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:50.879119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:50.880012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:50.880440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:50.880864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:50.881776 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:50.884007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:50.923540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 767/1530] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:50 2021] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:50.927924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:50.942002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1e29d-a35f-450b-b042-c1abcfb3deb0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.022529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.023223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.023503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.023771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.024485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.026465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.060901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 764/1531] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:50 2021] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:51.065351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.082275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c32a3-afa3-43a3-9ab0-985d1ebaf67a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.094014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.095089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.095578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.096059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.097017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.098907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.116153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 768/1532] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:51 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:51.120578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.134669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc086cf1-21c7-435e-b809-6d266878bd0f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.142618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78113a-2f92-4745-bcfb-43b8efdf58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.143311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78113a-2f92-4745-bcfb-43b8efdf58d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.143591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78113a-2f92-4745-bcfb-43b8efdf58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.143864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78113a-2f92-4745-bcfb-43b8efdf58d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.144622 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78113a-2f92-4745-bcfb-43b8efdf58d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.146267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78113a-2f92-4745-bcfb-43b8efdf58d5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.160369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 765/1533] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:51 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:51.164612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.179197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bd63b-3076-47c3-896f-5e9e0afe70e3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.193754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0534-ed50-414c-b785-e16c23686fb7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.193754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0534-ed50-414c-b785-e16c23686fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.193754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b0534-ed50-414c-b785-e16c23686fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.221794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf39fb-3d22-42c7-9304-5b231dc53c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.231685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf39fb-3d22-42c7-9304-5b231dc53c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.232830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf39fb-3d22-42c7-9304-5b231dc53c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.233319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf39fb-3d22-42c7-9304-5b231dc53c39 admin admin] PATH_INFO: `/v3/projects/b9840e08acad4f96a65962ff11498530/users/74235adea3324175a7eeacb2d3dab289/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.257464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d55b0534-ed50-414c-b785-e16c23686fb7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.257464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d55b0534-ed50-414c-b785-e16c23686fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.276416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 766/1534] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.291318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9db81-cff7-451b-b1be-6e8cd07d960e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.291654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9db81-cff7-451b-b1be-6e8cd07d960e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.291875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9db81-cff7-451b-b1be-6e8cd07d960e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.292945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf39fb-3d22-42c7-9304-5b231dc53c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9840e08acad4f96a65962ff11498530, user_id=74235adea3324175a7eeacb2d3dab289, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.296036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf39fb-3d22-42c7-9304-5b231dc53c39 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.324168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-24b9db81-cff7-451b-b1be-6e8cd07d960e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.325352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-24b9db81-cff7-451b-b1be-6e8cd07d960e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.330649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 769/1535] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:51 2021] PUT /identity/v3/projects/b9840e08acad4f96a65962ff11498530/users/74235adea3324175a7eeacb2d3dab289/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:51.345868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607139-c46f-45a7-bfd0-3c8276cbce34 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.346666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607139-c46f-45a7-bfd0-3c8276cbce34 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.347151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55607139-c46f-45a7-bfd0-3c8276cbce34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.382214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-55607139-c46f-45a7-bfd0-3c8276cbce34 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.384003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-55607139-c46f-45a7-bfd0-3c8276cbce34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.461454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 767/1536] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.462851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2c46-1c1a-4aad-abf6-56f15f4dfdc2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.463137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2c46-1c1a-4aad-abf6-56f15f4dfdc2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.463412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2c46-1c1a-4aad-abf6-56f15f4dfdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.487663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3cca2c46-1c1a-4aad-abf6-56f15f4dfdc2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.488500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3cca2c46-1c1a-4aad-abf6-56f15f4dfdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.491358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 770/1537] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:16:51.492935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a32eeb-4c6b-4852-b8a5-bb55130a2ac4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.493459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a32eeb-4c6b-4852-b8a5-bb55130a2ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.493931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a32eeb-4c6b-4852-b8a5-bb55130a2ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.514118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 768/1538] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.514983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2c46-1c1a-4aad-abf6-56f15f4dfdc2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.519460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-24a32eeb-4c6b-4852-b8a5-bb55130a2ac4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.520743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-24a32eeb-4c6b-4852-b8a5-bb55130a2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.533173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 771/1539] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.533753 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2c46-1c1a-4aad-abf6-56f15f4dfdc2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.535511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97413-80d8-46bb-ae80-a849d4c9b69e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.535794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97413-80d8-46bb-ae80-a849d4c9b69e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.536065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd97413-80d8-46bb-ae80-a849d4c9b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.543878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.544704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.544980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.545253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.546034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:51.546346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.587122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.611454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9bd97413-80d8-46bb-ae80-a849d4c9b69e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.612677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9bd97413-80d8-46bb-ae80-a849d4c9b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.618000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 769/1540] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:51.619223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.632125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 772/1541] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.633631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9f2c-6a39-4599-a36b-8ab33a010898 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.633913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9f2c-6a39-4599-a36b-8ab33a010898 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.634186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f9f2c-6a39-4599-a36b-8ab33a010898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.667390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-705f9f2c-6a39-4599-a36b-8ab33a010898 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.669465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-705f9f2c-6a39-4599-a36b-8ab33a010898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.686310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 773/1542] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.687607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f9f2c-6a39-4599-a36b-8ab33a010898 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.699290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f9f2c-6a39-4599-a36b-8ab33a010898 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.702462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f3b34-e134-494d-a713-8c806f53c615 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.704706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.705380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.705691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.706081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.706804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.707134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb6385-1816-4785-8827-9f2ef41560c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.707794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb6385-1816-4785-8827-9f2ef41560c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.708078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb6385-1816-4785-8827-9f2ef41560c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.708356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb6385-1816-4785-8827-9f2ef41560c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.708944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.720862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb6385-1816-4785-8827-9f2ef41560c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.722999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb6385-1816-4785-8827-9f2ef41560c9 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.735470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 770/1543] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:51.738913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1d00a-b22f-4fff-8bbc-c39703351a15 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.739357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1d00a-b22f-4fff-8bbc-c39703351a15 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.739629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1d00a-b22f-4fff-8bbc-c39703351a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.743202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 774/1544] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:51.744268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.765794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b1a1d00a-b22f-4fff-8bbc-c39703351a15 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.767038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b1a1d00a-b22f-4fff-8bbc-c39703351a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.823970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5248c-4c2f-4650-9f1f-06f5a2c05bab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.829647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395dec7d-3fa1-483a-bc02-932bf5fbd67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.830419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dec7d-3fa1-483a-bc02-932bf5fbd67b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.830802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dec7d-3fa1-483a-bc02-932bf5fbd67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.831174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395dec7d-3fa1-483a-bc02-932bf5fbd67b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.832055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dec7d-3fa1-483a-bc02-932bf5fbd67b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:51.832813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dec7d-3fa1-483a-bc02-932bf5fbd67b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.834626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395dec7d-3fa1-483a-bc02-932bf5fbd67b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.835562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 771/1545] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.837087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea94ec-9b13-40fd-93ca-143d936c3918 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.837924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea94ec-9b13-40fd-93ca-143d936c3918 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.838143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea94ec-9b13-40fd-93ca-143d936c3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.850107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 775/1546] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:51.852583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a583b7e-6c78-45f3-ad92-e22f36ebf785 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.853076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a583b7e-6c78-45f3-ad92-e22f36ebf785 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.853353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a583b7e-6c78-45f3-ad92-e22f36ebf785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.864591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-16ea94ec-9b13-40fd-93ca-143d936c3918 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.865999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-16ea94ec-9b13-40fd-93ca-143d936c3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.874709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 772/1547] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.875577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea94ec-9b13-40fd-93ca-143d936c3918 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.882154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3a583b7e-6c78-45f3-ad92-e22f36ebf785 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.883485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3a583b7e-6c78-45f3-ad92-e22f36ebf785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.885205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea94ec-9b13-40fd-93ca-143d936c3918 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.890569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ca163-cf70-45c7-9b7d-e27027593958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.891252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca163-cf70-45c7-9b7d-e27027593958 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.891528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca163-cf70-45c7-9b7d-e27027593958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.892022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ca163-cf70-45c7-9b7d-e27027593958 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.892137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 776/1548] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.892541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ca163-cf70-45c7-9b7d-e27027593958 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:51.892647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a583b7e-6c78-45f3-ad92-e22f36ebf785 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.893017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ca163-cf70-45c7-9b7d-e27027593958 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.895029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ca163-cf70-45c7-9b7d-e27027593958 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.906455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a583b7e-6c78-45f3-ad92-e22f36ebf785 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.910375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 773/1549] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:51.911375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0fe6-2ed7-43db-9c32-fd8367e72896 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.911669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0fe6-2ed7-43db-9c32-fd8367e72896 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.911947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff0fe6-2ed7-43db-9c32-fd8367e72896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.914446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.915188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.915525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.915737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.916454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.918756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.931245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-54ff0fe6-2ed7-43db-9c32-fd8367e72896 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.932655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-54ff0fe6-2ed7-43db-9c32-fd8367e72896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.943447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 777/1551] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/users => generated 286 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:51.943680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 774/1551] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.944830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:51.944990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7f30-4b05-42a8-8299-896c7ed83b5c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.945135 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7f30-4b05-42a8-8299-896c7ed83b5c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.945499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf7f30-4b05-42a8-8299-896c7ed83b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.963545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422bd1d-5121-4476-9d1f-916f21c41b82 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:51.968952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f3bf7f30-4b05-42a8-8299-896c7ed83b5c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:51.970215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f3bf7f30-4b05-42a8-8299-896c7ed83b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:51.973548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796d091-d0eb-4642-8b37-0e5eb4185cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:51.974389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d091-d0eb-4642-8b37-0e5eb4185cca admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.974828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d091-d0eb-4642-8b37-0e5eb4185cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.975157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796d091-d0eb-4642-8b37-0e5eb4185cca admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:51.976027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796d091-d0eb-4642-8b37-0e5eb4185cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:51.990209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796d091-d0eb-4642-8b37-0e5eb4185cca admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:51.990760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 775/1552] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:51.990760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb19b0-39cc-48b1-9e2c-c1aed8b10380 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:51.990760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb19b0-39cc-48b1-9e2c-c1aed8b10380 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:51.990760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb19b0-39cc-48b1-9e2c-c1aed8b10380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.010652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-79bb19b0-39cc-48b1-9e2c-c1aed8b10380 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:52.012380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-79bb19b0-39cc-48b1-9e2c-c1aed8b10380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:52.014855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 778/1553] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.016296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa319-f196-466b-a54d-0973b2799520 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.016639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa319-f196-466b-a54d-0973b2799520 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.016972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa319-f196-466b-a54d-0973b2799520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.040752 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-aaefa319-f196-466b-a54d-0973b2799520 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:52.042044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-aaefa319-f196-466b-a54d-0973b2799520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:52.088405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 776/1554] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:52.089197 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb19b0-39cc-48b1-9e2c-c1aed8b10380 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.099142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb19b0-39cc-48b1-9e2c-c1aed8b10380 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.104395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810fa15-9e13-44ad-b7c1-bec92f7ea1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.105098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810fa15-9e13-44ad-b7c1-bec92f7ea1ea admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.105378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810fa15-9e13-44ad-b7c1-bec92f7ea1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.105684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810fa15-9e13-44ad-b7c1-bec92f7ea1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.106417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810fa15-9e13-44ad-b7c1-bec92f7ea1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.108845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810fa15-9e13-44ad-b7c1-bec92f7ea1ea admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.125625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 779/1555] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:52.125625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa319-f196-466b-a54d-0973b2799520 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.136313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaefa319-f196-466b-a54d-0973b2799520 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.141578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.142278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.142552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.142822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.143642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.145337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.146585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 777/1556] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.150311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef284-ec23-45a5-b822-fdf2deb92fff None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.151072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef284-ec23-45a5-b822-fdf2deb92fff None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.152311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef284-ec23-45a5-b822-fdf2deb92fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.157668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 780/1557] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:52.158570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.168950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96200-c947-4d40-a68e-9921c403ec8d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.178407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-dd7ef284-ec23-45a5-b822-fdf2deb92fff None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:52.179840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dd7ef284-ec23-45a5-b822-fdf2deb92fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:52.253031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 778/1558] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:52.254089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef284-ec23-45a5-b822-fdf2deb92fff None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.265890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef284-ec23-45a5-b822-fdf2deb92fff None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.267701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.269407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.269790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.270214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.271033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:52.271347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.273043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.273802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.274674 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.275114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.275527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.276391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.278599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.294428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 781/1559] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:52.294428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.302921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73af87-ffc0-447e-8d14-b97e0968b18b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.309888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.311101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.311714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.311992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.312928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:52.313285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.315121 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 779/1560] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/users => generated 303 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.318480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.320545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.331657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff7a780-b892-4bc3-8e4d-6e237e77fb88 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.337581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 782/1561] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:52.338000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.338667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.339524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.340274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.340776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.341881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:52.342370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.344460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.352769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e2f17-9c43-4baa-834b-f8201cfeceb3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.359918 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 780/1562] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:52.361346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.365696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.367118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.369566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.369926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.371310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.373355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad52619-70b0-4244-a06e-5ef9a8b0189f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.374209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.382987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.384431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.384707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.385100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.385980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.387717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.399523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 781/1563] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:52.400168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.402898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 783/1564] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/users => generated 286 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.405994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.419754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f74c9-1f9d-4774-8961-5f3b1f0e979d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.422055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552e82f-3edb-42b3-b3a7-19253f5e6a87 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.426326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.427248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.427485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.427908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.428155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.428271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.428475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.429040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.429249 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.430496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:52.431225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.431379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.433126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.448190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 782/1565] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:16:52.448964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.462714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617162a2-f038-42fe-b717-ccfac72401e7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.468976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.469711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.469990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.470251 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.471224 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.472776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.473914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 784/1566] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/projects => generated 391 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.478032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.488185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 783/1567] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:52.489377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.499738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b1691-96be-4157-864b-8c0eb52cac3f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.561871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0584d9-1243-4fc0-9ede-7ee646da42fd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.568974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.570184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.570682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.571154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.572610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.575821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.576447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.576990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.577676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.578116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.579570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.583206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.631625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 785/1568] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.632709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.636879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 784/1569] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.636879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.708801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3541c8-2b99-4001-bdf1-fd69f4db4277 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.711287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127cc42f-141e-4cfc-ad81-569c07ec47ef admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.714155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.715173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.715453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.715756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.716575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.716846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.717786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.718063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.718332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] PATH_INFO: `/v3/projects/7f645d0b0f2d40129324fcd5a61c2d1c/users/37a74fcd59b54de0ae567965e05c0825/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.718456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.730256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 785/1570] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:52.731322 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.737837 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f645d0b0f2d40129324fcd5a61c2d1c, user_id=37a74fcd59b54de0ae567965e05c0825, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.740524 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.741530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5282c-5056-4779-8b4e-8a6a7e034a09 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.747102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.747800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.748077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.748349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.749065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.751045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.765527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 786/1571] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:52 2021] PUT /identity/v3/projects/7f645d0b0f2d40129324fcd5a61c2d1c/users/37a74fcd59b54de0ae567965e05c0825/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:52.765527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.792080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 786/1572] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.793328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.834522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15ebc7-dd1d-42d3-9b35-2e52758a1fb0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.870997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890194c-291b-490a-b6c3-933b54f91fef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.877729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.878426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.879021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.879300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.880387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.882813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.894814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0ddd4-0761-4128-99c5-6ad2b744a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.898307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 787/1573] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:52.898454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ddd4-0761-4128-99c5-6ad2b744a36a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.898454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ddd4-0761-4128-99c5-6ad2b744a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.898628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.898714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0ddd4-0761-4128-99c5-6ad2b744a36a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.898714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0ddd4-0761-4128-99c5-6ad2b744a36a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.899115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0ddd4-0761-4128-99c5-6ad2b744a36a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.909763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e9b31-65db-43c9-9de1-2788cac83f13 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.915414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.916093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.916370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.916637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.917367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.919305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.924159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 787/1574] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.924159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2134-a652-475b-bf15-e459841a3b7f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.924159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2134-a652-475b-bf15-e459841a3b7f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.924159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2134-a652-475b-bf15-e459841a3b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.941831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 788/1575] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.942658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:52.954739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9d3b2134-a652-475b-bf15-e459841a3b7f None None] MFA Rules not processed for user `74235adea3324175a7eeacb2d3dab289`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:52.956090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9d3b2134-a652-475b-bf15-e459841a3b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:52.956442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62154354-52c9-4214-8581-b15a158b25f8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:52.962105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:52.962790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:52.963069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:52.963339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:52.964059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:52.966079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:52.990798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 789/1576] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:52.991709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.001957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4daf140-ea33-49a1-b37f-bbab0caf6cdb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.008181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81815e6a-b785-48c3-9a7f-768eb3e3ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.008938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815e6a-b785-48c3-9a7f-768eb3e3ca31 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.009219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815e6a-b785-48c3-9a7f-768eb3e3ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.009547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81815e6a-b785-48c3-9a7f-768eb3e3ca31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.010419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81815e6a-b785-48c3-9a7f-768eb3e3ca31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.012025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81815e6a-b785-48c3-9a7f-768eb3e3ca31 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.024431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 790/1577] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.025662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f54b8-c5a9-42f2-82d5-bd1ce8276674 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.025951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f54b8-c5a9-42f2-82d5-bd1ce8276674 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.026224 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f54b8-c5a9-42f2-82d5-bd1ce8276674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.047731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 788/1578] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:52 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:53.048958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2134-a652-475b-bf15-e459841a3b7f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.065070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2134-a652-475b-bf15-e459841a3b7f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.065853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3a8f54b8-c5a9-42f2-82d5-bd1ce8276674 None None] MFA Rules not processed for user `37a74fcd59b54de0ae567965e05c0825`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:53.067138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3a8f54b8-c5a9-42f2-82d5-bd1ce8276674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:53.069875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.070600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.070878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.071299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.071850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.073819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.095633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 789/1579] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/users => generated 291 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:53.096488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.105978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6bc51-3270-49b0-85cd-22009d120ac1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.110944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.111820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.112098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.112388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] PATH_INFO: `/v3/projects/e4d221503ed04c31b9199525233a4bdc/users/9dbe4dd4102d4702a72bc416fd2f7b53/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.127296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d221503ed04c31b9199525233a4bdc, user_id=9dbe4dd4102d4702a72bc416fd2f7b53, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.129899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.134576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 791/1580] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:53.138571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f54b8-c5a9-42f2-82d5-bd1ce8276674 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.149361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f54b8-c5a9-42f2-82d5-bd1ce8276674 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.151249 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 790/1581] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:53 2021] PUT /identity/v3/projects/e4d221503ed04c31b9199525233a4bdc/users/9dbe4dd4102d4702a72bc416fd2f7b53/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:53.152391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.219473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.220169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.220433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.220692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.221459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.222528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c312958-cea1-4ad1-914b-f00e29f339c1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.223086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.227417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.228086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.228363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.228640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.229375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.231024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.233339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 792/1582] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.234222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.243630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aa919-6a58-41e9-9c9e-7bec988abf56 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.247606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 791/1583] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.247606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.250993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776990-5a67-4e7e-9730-9a1971939e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.251655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776990-5a67-4e7e-9730-9a1971939e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.251932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776990-5a67-4e7e-9730-9a1971939e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.252207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776990-5a67-4e7e-9730-9a1971939e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.252950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776990-5a67-4e7e-9730-9a1971939e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.254617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776990-5a67-4e7e-9730-9a1971939e01 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.257213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044088c-ad47-48e1-8a56-64edcc233a74 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.262277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.263155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.263807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.264114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] PATH_INFO: `/v3/projects/12882c2b76424e97b392e96c1a834ed9/users/6239fca79b7f4618ab2282126c412f35/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.264772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 793/1584] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.266868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548c8ab-0463-4549-837b-890a1ee38277 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.267369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548c8ab-0463-4549-837b-890a1ee38277 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.267642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548c8ab-0463-4549-837b-890a1ee38277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.279941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12882c2b76424e97b392e96c1a834ed9, user_id=6239fca79b7f4618ab2282126c412f35, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.282632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.286385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3548c8ab-0463-4549-837b-890a1ee38277 None None] MFA Rules not processed for user `74235adea3324175a7eeacb2d3dab289`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:53.287875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3548c8ab-0463-4549-837b-890a1ee38277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:53.297286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 792/1585] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:53 2021] PUT /identity/v3/projects/12882c2b76424e97b392e96c1a834ed9/users/6239fca79b7f4618ab2282126c412f35/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:53.298167 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.347328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 794/1586] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:53.348488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77d49a-1d35-4f2b-9991-cd205e54896a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.348764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77d49a-1d35-4f2b-9991-cd205e54896a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.349044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77d49a-1d35-4f2b-9991-cd205e54896a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.380963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6152c-af3c-480c-89be-763f3eb45198 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.387698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5d77d49a-1d35-4f2b-9991-cd205e54896a None None] MFA Rules not processed for user `9dbe4dd4102d4702a72bc416fd2f7b53`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:53.389092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f32d0-1d57-47f4-a131-84768bd6dc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.389648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5d77d49a-1d35-4f2b-9991-cd205e54896a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:53.390215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f32d0-1d57-47f4-a131-84768bd6dc90 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.390667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f32d0-1d57-47f4-a131-84768bd6dc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.391131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f32d0-1d57-47f4-a131-84768bd6dc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.392387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f32d0-1d57-47f4-a131-84768bd6dc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.395206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f32d0-1d57-47f4-a131-84768bd6dc90 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.410142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 793/1587] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.411539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae4fa-345d-499c-8dff-c47eb2c4f860 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.411828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae4fa-345d-499c-8dff-c47eb2c4f860 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.412122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dae4fa-345d-499c-8dff-c47eb2c4f860 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.414114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 794/1588] 10.222.0.31 () {54 vars in 961 bytes} [Tue Nov 16 03:16:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:16:53.414834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae4fa-345d-499c-8dff-c47eb2c4f860 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.427978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dae4fa-345d-499c-8dff-c47eb2c4f860 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.433310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.434045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.434327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.434602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.435478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.437549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.451179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 795/1589] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.451179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.459579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851f68a-2c1e-44cf-9290-4f977a5599cd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.462147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 795/1590] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:53.462896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77d49a-1d35-4f2b-9991-cd205e54896a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.467933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c530946-9f09-4092-b568-4ef6739fc581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.468676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c530946-9f09-4092-b568-4ef6739fc581 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.469030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c530946-9f09-4092-b568-4ef6739fc581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.469304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c530946-9f09-4092-b568-4ef6739fc581 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.470112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c530946-9f09-4092-b568-4ef6739fc581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.471731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c530946-9f09-4092-b568-4ef6739fc581 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.473684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77d49a-1d35-4f2b-9991-cd205e54896a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.478313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f957fb3-9dba-46f0-baa4-67479770e4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.478979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957fb3-9dba-46f0-baa4-67479770e4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.479257 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957fb3-9dba-46f0-baa4-67479770e4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.479529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957fb3-9dba-46f0-baa4-67479770e4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.480273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f957fb3-9dba-46f0-baa4-67479770e4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.482106 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f957fb3-9dba-46f0-baa4-67479770e4ab admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.485648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 796/1591] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.485648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac427-8073-45f1-b14f-59784dfeb648 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.485648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac427-8073-45f1-b14f-59784dfeb648 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.485648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ac427-8073-45f1-b14f-59784dfeb648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.498533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 796/1592] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.498533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472b11-aac2-4243-a188-3a5ca2c6c02c None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.498533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472b11-aac2-4243-a188-3a5ca2c6c02c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.498533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94472b11-aac2-4243-a188-3a5ca2c6c02c None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.499925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 797/1593] 10.222.0.31 () {54 vars in 961 bytes} [Tue Nov 16 03:16:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:16:53.500709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472b11-aac2-4243-a188-3a5ca2c6c02c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.513009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94472b11-aac2-4243-a188-3a5ca2c6c02c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.513628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-619ac427-8073-45f1-b14f-59784dfeb648 None None] MFA Rules not processed for user `6239fca79b7f4618ab2282126c412f35`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:53.514908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-619ac427-8073-45f1-b14f-59784dfeb648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:53.518445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e3a80-801f-4b8f-9b47-f1565a89b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.519123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3a80-801f-4b8f-9b47-f1565a89b2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.519404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3a80-801f-4b8f-9b47-f1565a89b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.519685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e3a80-801f-4b8f-9b47-f1565a89b2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.520434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3a80-801f-4b8f-9b47-f1565a89b2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.522081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e3a80-801f-4b8f-9b47-f1565a89b2c7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.533280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 798/1594] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:53.535187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84294a-6976-41ad-84a0-cbc2207fb089 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.535403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84294a-6976-41ad-84a0-cbc2207fb089 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.535683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84294a-6976-41ad-84a0-cbc2207fb089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.554188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-de84294a-6976-41ad-84a0-cbc2207fb089 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:53.555408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de84294a-6976-41ad-84a0-cbc2207fb089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:53.583521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 797/1595] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:53.584388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac427-8073-45f1-b14f-59784dfeb648 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.596509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ac427-8073-45f1-b14f-59784dfeb648 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.602618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.603521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.603801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.604071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] PATH_INFO: `/v3/projects/e487df53678d4cd890ccf9e6c950fa5e/users/1f1edff84d4e4fc99dd8158012f3e77d/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.619221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e487df53678d4cd890ccf9e6c950fa5e, user_id=1f1edff84d4e4fc99dd8158012f3e77d, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.621914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.624596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 799/1596] 10.222.0.31 () {58 vars in 1058 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:53.625292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84294a-6976-41ad-84a0-cbc2207fb089 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.636688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84294a-6976-41ad-84a0-cbc2207fb089 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.638051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 798/1597] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:53 2021] PUT /identity/v3/projects/e487df53678d4cd890ccf9e6c950fa5e/users/1f1edff84d4e4fc99dd8158012f3e77d/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:53.642324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.694591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.695239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.695524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.695825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.696544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.698591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.703925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bc4e8-3110-4264-b650-bfb7abb77322 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.709105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78b7d8-f273-4e27-a892-545ad759a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.710032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78b7d8-f273-4e27-a892-545ad759a84d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.710310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78b7d8-f273-4e27-a892-545ad759a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.710577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78b7d8-f273-4e27-a892-545ad759a84d admin admin] PATH_INFO: `/v3/projects/cfee12c8cac74d1ea51217408535dc62/users/def95d0599f54c7b9a9fc36ba1742387/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.726753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78b7d8-f273-4e27-a892-545ad759a84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfee12c8cac74d1ea51217408535dc62, user_id=def95d0599f54c7b9a9fc36ba1742387, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.726996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 800/1598] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:53.727724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.729692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78b7d8-f273-4e27-a892-545ad759a84d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.744821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 799/1599] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:53 2021] PUT /identity/v3/projects/cfee12c8cac74d1ea51217408535dc62/users/def95d0599f54c7b9a9fc36ba1742387/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:53.746402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c1e3-e92d-4035-ba38-6dbc1f78ad69 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.746700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c1e3-e92d-4035-ba38-6dbc1f78ad69 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.747008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6c1e3-e92d-4035-ba38-6dbc1f78ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.770354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-80b6c1e3-e92d-4035-ba38-6dbc1f78ad69 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:53.771567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-80b6c1e3-e92d-4035-ba38-6dbc1f78ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:53.796698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15cbd6-2923-4d23-8596-521c163ee4c4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.839098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 800/1600] 10.222.0.31 () {58 vars in 1058 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:53.839944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c1e3-e92d-4035-ba38-6dbc1f78ad69 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.855826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.856735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.857187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.858156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] PATH_INFO: `/v3/projects/61a2e084639344ff8e8d5ade2eef51d0/users/681c813529d941f688bff8333ad3b089/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.874059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61a2e084639344ff8e8d5ade2eef51d0, user_id=681c813529d941f688bff8333ad3b089, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.876790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.891065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 801/1601] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:53 2021] PUT /identity/v3/projects/61a2e084639344ff8e8d5ade2eef51d0/users/681c813529d941f688bff8333ad3b089/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:53.892592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:53.907129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6c1e3-e92d-4035-ba38-6dbc1f78ad69 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.957770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56aa7-83f6-4524-81bb-eac29c49c724 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:53.962981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.963675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.963956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.964227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.964935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.966151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51338d3-5aec-4e15-8c1b-2da3f9c1d0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:53.966950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.967145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51338d3-5aec-4e15-8c1b-2da3f9c1d0d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:53.967368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51338d3-5aec-4e15-8c1b-2da3f9c1d0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:53.967636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51338d3-5aec-4e15-8c1b-2da3f9c1d0d8 admin admin] PATH_INFO: `/v3/projects/56aae1d7526145a0b92518c507f24343/users/2233ae9efa4a425b88f4653e357dd5f7/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:53.983120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51338d3-5aec-4e15-8c1b-2da3f9c1d0d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aae1d7526145a0b92518c507f24343, user_id=2233ae9efa4a425b88f4653e357dd5f7, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:53.986254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51338d3-5aec-4e15-8c1b-2da3f9c1d0d8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:53.996013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 802/1602] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:53 2021] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:53.996891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.000253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 801/1603] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:53 2021] PUT /identity/v3/projects/56aae1d7526145a0b92518c507f24343/users/2233ae9efa4a425b88f4653e357dd5f7/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:54.001578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ff39-1f69-408b-8e7d-686f15360f42 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.001867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ff39-1f69-408b-8e7d-686f15360f42 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.002142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5ff39-1f69-408b-8e7d-686f15360f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.020276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-77a5ff39-1f69-408b-8e7d-686f15360f42 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:54.021528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-77a5ff39-1f69-408b-8e7d-686f15360f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:54.071062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884fb60-0e79-4355-9118-d34cfa942ae6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.077139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.077830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.078139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.078415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.081098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 802/1604] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:54.082102 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5ff39-1f69-408b-8e7d-686f15360f42 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.093061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5ff39-1f69-408b-8e7d-686f15360f42 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.097850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2c61-3f90-4dba-a699-de631c01cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.098528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2c61-3f90-4dba-a699-de631c01cfdb admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.098809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2c61-3f90-4dba-a699-de631c01cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.099075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2c61-3f90-4dba-a699-de631c01cfdb admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.099779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c2c61-3f90-4dba-a699-de631c01cfdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.101764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c2c61-3f90-4dba-a699-de631c01cfdb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.125401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 803/1605] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/users => generated 309 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:54.125401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb9c5-1bc5-4974-88d9-ea64719a8b41 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.125401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb9c5-1bc5-4974-88d9-ea64719a8b41 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.125401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfb9c5-1bc5-4974-88d9-ea64719a8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.136419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.138096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.147669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 803/1606] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:53 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:54.148506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.152172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-dfdfb9c5-1bc5-4974-88d9-ea64719a8b41 None None] MFA Rules not processed for user `def95d0599f54c7b9a9fc36ba1742387`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:54.153377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-dfdfb9c5-1bc5-4974-88d9-ea64719a8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:54.160209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcf60f-3250-4ab0-968f-d508d2ec5bea service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.166231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.166887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.167268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.167440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.222202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 804/1607] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:54.222202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ed28-cb60-4e6c-9a22-6a65a349b199 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.222202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ed28-cb60-4e6c-9a22-6a65a349b199 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.222202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd14ed28-cb60-4e6c-9a22-6a65a349b199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.226712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.228443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.238155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bd14ed28-cb60-4e6c-9a22-6a65a349b199 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:54.238720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 804/1608] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:54 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:54.239524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.246590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bd14ed28-cb60-4e6c-9a22-6a65a349b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:54.249890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354532e3-799f-4520-84c8-5e232cdd6cd2 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.254831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.255630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.256009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.256373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.257178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.257858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 805/1609] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:54.259342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.259807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03a83-8883-4f3d-8856-41d601a4854a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.260386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03a83-8883-4f3d-8856-41d601a4854a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.260945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa03a83-8883-4f3d-8856-41d601a4854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.294350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 805/1610] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:54.294350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.296189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5fa03a83-8883-4f3d-8856-41d601a4854a None None] MFA Rules not processed for user `2233ae9efa4a425b88f4653e357dd5f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:54.297935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5fa03a83-8883-4f3d-8856-41d601a4854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:54.298460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:54.366222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d45cf-fc0a-44fc-ba6d-57307fb6493a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.380575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.381392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.389203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 806/1611] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:54.390092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03a83-8883-4f3d-8856-41d601a4854a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.395943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.395943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.405673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa03a83-8883-4f3d-8856-41d601a4854a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.411153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.411916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.412908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.413213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.416366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.417409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.418324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.420815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.430717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 807/1612] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:54 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:54.431832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.434647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 806/1613] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:54.436009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.446118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b0191-407c-4ca0-9161-e0d8f70b89ff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.446314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48a944-f5e0-4be8-8e92-05bdd1e18afa service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.451105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.451659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.451864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.452092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.452368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.452498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.452660 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.452931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.453693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.455654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.465268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.467699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.482070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 807/1614] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:54.482996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.492008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 808/1615] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:54.492008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.494709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cabb84-8694-449d-9df7-1043e51e9317 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.568566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.569014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369b450-14fc-4a1b-9443-ae94e48b4532 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.569260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.569602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.570008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.570633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.572277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.576510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00270e40-0d94-47b8-a38b-2baa8bab5b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.577709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270e40-0d94-47b8-a38b-2baa8bab5b9d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.578186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270e40-0d94-47b8-a38b-2baa8bab5b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.578690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00270e40-0d94-47b8-a38b-2baa8bab5b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.579677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00270e40-0d94-47b8-a38b-2baa8bab5b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.582185 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00270e40-0d94-47b8-a38b-2baa8bab5b9d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.587794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 808/1616] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:54 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:54.587794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.597791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4307545-3612-4608-bf1b-dbe8386a5bc7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.605140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079bcc9-0dff-4090-9da7-1e18cef4ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.606461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079bcc9-0dff-4090-9da7-1e18cef4ee6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.607373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079bcc9-0dff-4090-9da7-1e18cef4ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.607810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079bcc9-0dff-4090-9da7-1e18cef4ee6e admin admin] PATH_INFO: `/v3/projects/d6106de212c64a39b58588b6e2bd05c2/users/1a8bc853873c46f68181bd7c4ea7a318/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.623234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 809/1617] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:54.624723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470487b-d2d1-4048-925a-86a8da30dd41 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.624997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470487b-d2d1-4048-925a-86a8da30dd41 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.625278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470487b-d2d1-4048-925a-86a8da30dd41 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.630474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079bcc9-0dff-4090-9da7-1e18cef4ee6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6106de212c64a39b58588b6e2bd05c2, user_id=1a8bc853873c46f68181bd7c4ea7a318, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.632018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 810/1618] 10.222.0.31 () {54 vars in 912 bytes} [Tue Nov 16 03:16:54 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:16:54.633212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470487b-d2d1-4048-925a-86a8da30dd41 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.634559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079bcc9-0dff-4090-9da7-1e18cef4ee6e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.659843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 809/1619] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:54 2021] PUT /identity/v3/projects/d6106de212c64a39b58588b6e2bd05c2/users/1a8bc853873c46f68181bd7c4ea7a318/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:54.659843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b5c54-0cd5-4122-8526-8e2d97e1cc5e None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.659843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b5c54-0cd5-4122-8526-8e2d97e1cc5e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.659843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b5c54-0cd5-4122-8526-8e2d97e1cc5e None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.659843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 810/1620] 10.222.0.31 () {54 vars in 912 bytes} [Tue Nov 16 03:16:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:16:54.660377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b5c54-0cd5-4122-8526-8e2d97e1cc5e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.726261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470487b-d2d1-4048-925a-86a8da30dd41 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.742067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b5c54-0cd5-4122-8526-8e2d97e1cc5e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.749062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.750371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.750677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.751014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] PATH_INFO: `/v3/projects/aaccbdb35286412a883c7cd4bbb09535/users/d47234b01d59478bb90346ec884717df/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.779057 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaccbdb35286412a883c7cd4bbb09535, user_id=d47234b01d59478bb90346ec884717df, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.782183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.790303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc58fff-6f63-4f90-b9ef-a5fac98b4dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.791033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc58fff-6f63-4f90-b9ef-a5fac98b4dcb admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.791316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc58fff-6f63-4f90-b9ef-a5fac98b4dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.791642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc58fff-6f63-4f90-b9ef-a5fac98b4dcb admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.792358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc58fff-6f63-4f90-b9ef-a5fac98b4dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.794406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc58fff-6f63-4f90-b9ef-a5fac98b4dcb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.801199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 811/1621] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:54 2021] PUT /identity/v3/projects/aaccbdb35286412a883c7cd4bbb09535/users/d47234b01d59478bb90346ec884717df/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:54.802757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.824485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 811/1622] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:54.826354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272585e-f21f-4e82-b0c3-0cb907c7eb84 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.829085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272585e-f21f-4e82-b0c3-0cb907c7eb84 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.829397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272585e-f21f-4e82-b0c3-0cb907c7eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.851078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c272585e-f21f-4e82-b0c3-0cb907c7eb84 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:54.852364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c272585e-f21f-4e82-b0c3-0cb907c7eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:54.882364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169baae-ec9c-4ce8-b08d-5beb9c176f2c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.887771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.888772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.889446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.889889 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.891173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.893714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.926847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 812/1623] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/users => generated 297 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:54.928064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:54.941646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb39515-81ce-404b-ba39-6ebe8c00323d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:54.948587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bfc6e-f11f-43c6-b605-a6d0e7a12948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:54.950711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bfc6e-f11f-43c6-b605-a6d0e7a12948 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.951051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bfc6e-f11f-43c6-b605-a6d0e7a12948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.951328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bfc6e-f11f-43c6-b605-a6d0e7a12948 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.953483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bfc6e-f11f-43c6-b605-a6d0e7a12948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:54.955554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bfc6e-f11f-43c6-b605-a6d0e7a12948 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:54.977510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 813/1624] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:54 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:54.977510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53932016-9e87-4bbe-9190-1f5cb30c07d8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:54.977510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53932016-9e87-4bbe-9190-1f5cb30c07d8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:54.977510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53932016-9e87-4bbe-9190-1f5cb30c07d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:54.993745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 812/1625] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:55.000411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272585e-f21f-4e82-b0c3-0cb907c7eb84 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.011976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-53932016-9e87-4bbe-9190-1f5cb30c07d8 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:55.013090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272585e-f21f-4e82-b0c3-0cb907c7eb84 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.013885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-53932016-9e87-4bbe-9190-1f5cb30c07d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:55.018527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.019227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.019711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.020040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.021401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.023416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.032180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 814/1626] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:16:54 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:55.033571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53932016-9e87-4bbe-9190-1f5cb30c07d8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.035664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 813/1627] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:54 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:55.036602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.056473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ee520-04bd-4df7-9232-fd7132006bd5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.060297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53932016-9e87-4bbe-9190-1f5cb30c07d8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.062749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.063445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.063730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.064007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.065041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.066962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.068117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.068997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.069401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.069831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.070848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.073141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.081307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 814/1628] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:55.082516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.093570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 815/1629] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:55.093570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.098263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2dc4c-9dc7-46b7-a7c8-e8c99d8bb598 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.104602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.105825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.106234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.106518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] PATH_INFO: `/v3/projects/d6106de212c64a39b58588b6e2bd05c2/users/1a8bc853873c46f68181bd7c4ea7a318/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.109038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6106de212c64a39b58588b6e2bd05c2, user_id=1a8bc853873c46f68181bd7c4ea7a318, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.112414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.138379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 815/1630] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:55 2021] PUT /identity/v3/projects/d6106de212c64a39b58588b6e2bd05c2/users/1a8bc853873c46f68181bd7c4ea7a318/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:55.139696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.211135 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ef055-f887-48ba-a326-0951eb6a8c35 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.262699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4b1ad-2866-4dd3-843e-0c2851ecfdc8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.268593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.269567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.269853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.270132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] PATH_INFO: `/v3/projects/aaccbdb35286412a883c7cd4bbb09535/users/d47234b01d59478bb90346ec884717df/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.272442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaccbdb35286412a883c7cd4bbb09535, user_id=d47234b01d59478bb90346ec884717df, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.275287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.294150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 816/1631] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:55 2021] PUT /identity/v3/projects/aaccbdb35286412a883c7cd4bbb09535/users/d47234b01d59478bb90346ec884717df/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:55.296363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.297053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.297531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.297662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.297760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.302900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:55.379570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e75ec-9a5b-4f6c-abbc-a229b4e150e4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.389464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.390572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.391364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.391881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.419275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.422125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.449695 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 816/1632] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:55.452626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.478697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168cd19-652a-4ca3-bd12-952f54e824dd service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.508959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.510782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.527795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 817/1633] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:55.528744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.617370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b836eeb-4ad0-41f3-8b24-1325589bfd0d service glance] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:55.624212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a852b-3574-4997-9a6c-2301e93a3584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.625240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a852b-3574-4997-9a6c-2301e93a3584 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.625545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a852b-3574-4997-9a6c-2301e93a3584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.626476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a852b-3574-4997-9a6c-2301e93a3584 admin admin] PATH_INFO: `/v3/projects/8be11fc7db6b418cba9a8f29d90162ee/users/cda509ce8f8d4e478b68798ef7abda1a/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.644674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a852b-3574-4997-9a6c-2301e93a3584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be11fc7db6b418cba9a8f29d90162ee, user_id=cda509ce8f8d4e478b68798ef7abda1a, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.647521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a852b-3574-4997-9a6c-2301e93a3584 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.676131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 818/1634] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:55 2021] PUT /identity/v3/projects/8be11fc7db6b418cba9a8f29d90162ee/users/cda509ce8f8d4e478b68798ef7abda1a/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:55.676131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af4d05-5a97-44af-8b6c-daf5de0b84f1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.676131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af4d05-5a97-44af-8b6c-daf5de0b84f1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.676131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af4d05-5a97-44af-8b6c-daf5de0b84f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.726244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e2af4d05-5a97-44af-8b6c-daf5de0b84f1 None None] MFA Rules not processed for user `1a8bc853873c46f68181bd7c4ea7a318`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:55.727649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e2af4d05-5a97-44af-8b6c-daf5de0b84f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:55.733145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7dead-f575-48d4-a304-ca92fb425c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:55.736770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7dead-f575-48d4-a304-ca92fb425c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.736770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7dead-f575-48d4-a304-ca92fb425c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.736770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7dead-f575-48d4-a304-ca92fb425c30 admin admin] PATH_INFO: `/v3/projects/ddf75dba3913407cac173b259f779df2/users/a01c9fb261da4c96a042a9f47e1c75e4/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.776931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7dead-f575-48d4-a304-ca92fb425c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf75dba3913407cac173b259f779df2, user_id=a01c9fb261da4c96a042a9f47e1c75e4, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:55.790653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7dead-f575-48d4-a304-ca92fb425c30 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:55.841031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 817/1635] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:55 2021] PUT /identity/v3/projects/ddf75dba3913407cac173b259f779df2/users/a01c9fb261da4c96a042a9f47e1c75e4/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:55.846408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9bccb-5a2b-4080-acaf-947bda02d306 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:55.852913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9bccb-5a2b-4080-acaf-947bda02d306 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:55.853727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9bccb-5a2b-4080-acaf-947bda02d306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:55.862758 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 819/1636] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:55 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:55.868157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af4d05-5a97-44af-8b6c-daf5de0b84f1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:55.967390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-12b9bccb-5a2b-4080-acaf-947bda02d306 None None] MFA Rules not processed for user `d47234b01d59478bb90346ec884717df`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:55.968711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-12b9bccb-5a2b-4080-acaf-947bda02d306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:55.976413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af4d05-5a97-44af-8b6c-daf5de0b84f1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:56.073335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:56.074362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.074783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.075209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.076134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:56.077959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:56.091082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 818/1637] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:55 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:56.092589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9bccb-5a2b-4080-acaf-947bda02d306 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:56.103174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 820/1638] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:55 2021] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:56.104469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:56.124847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9bccb-5a2b-4080-acaf-947bda02d306 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:56.136830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb9355-c5a6-4f17-95e0-ff04e8e94765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:56.137890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb9355-c5a6-4f17-95e0-ff04e8e94765 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.138512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb9355-c5a6-4f17-95e0-ff04e8e94765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.139015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb9355-c5a6-4f17-95e0-ff04e8e94765 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.140000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb9355-c5a6-4f17-95e0-ff04e8e94765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:56.142101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb9355-c5a6-4f17-95e0-ff04e8e94765 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:56.164357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 819/1639] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:56 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:56.166151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb419d-62d1-4042-89db-166d870f59ef None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.167574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb419d-62d1-4042-89db-166d870f59ef None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.168017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb419d-62d1-4042-89db-166d870f59ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.189094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d1f6b-8497-46b2-926a-0489856e1286 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:56.193455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:56.194517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.195512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.195981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.210069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-12cb419d-62d1-4042-89db-166d870f59ef None None] MFA Rules not processed for user `681c813529d941f688bff8333ad3b089`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:56.211616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-12cb419d-62d1-4042-89db-166d870f59ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:56.306860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 820/1640] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:56 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:56.308088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb419d-62d1-4042-89db-166d870f59ef None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:56.326817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:56.327597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb419d-62d1-4042-89db-166d870f59ef None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:56.332255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:56.333143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:56.334311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.334774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.335240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] PATH_INFO: `/v3/users/37a74fcd59b54de0ae567965e05c0825` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.337399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a74fcd59b54de0ae567965e05c0825)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:56.338673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: WARNING py.warnings [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:16:56.338673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: warnings.warn(msg) Nov 16 03:16:56.338673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: Nov 16 03:16:56.340864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:56.362422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 821/1641] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:56 2021] GET /identity/v3/auth/tokens => generated 3339 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:56.364099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:56.393154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70dbbe-e811-452f-94c9-e5031a789acb service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:56.402781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:56.405702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.406572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.407234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] PATH_INFO: `/v3/projects/8be11fc7db6b418cba9a8f29d90162ee/users/cda509ce8f8d4e478b68798ef7abda1a/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.411624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be11fc7db6b418cba9a8f29d90162ee, user_id=cda509ce8f8d4e478b68798ef7abda1a, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:56.416470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:56.449913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 822/1642] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:56 2021] PUT /identity/v3/projects/8be11fc7db6b418cba9a8f29d90162ee/users/cda509ce8f8d4e478b68798ef7abda1a/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:56.451120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:56.469060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a74fcd59b54de0ae567965e05c0825'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:56.470150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a74fcd59b54de0ae567965e05c0825'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:56.489614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a74fcd59b54de0ae567965e05c0825'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:56.514580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a74fcd59b54de0ae567965e05c0825'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:56.534358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69c8cfa4-b18b-412e-b024-fac96ab772a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a74fcd59b54de0ae567965e05c0825'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:56.549513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 821/1643] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:16:56 2021] DELETE /identity/v3/users/37a74fcd59b54de0ae567965e05c0825 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:56.551345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27007-72d3-4e58-9977-0f98f0cf0985 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.551600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27007-72d3-4e58-9977-0f98f0cf0985 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.551877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff27007-72d3-4e58-9977-0f98f0cf0985 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.554073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 822/1644] 10.222.0.31 () {54 vars in 912 bytes} [Tue Nov 16 03:16:56 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:16:56.554892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff27007-72d3-4e58-9977-0f98f0cf0985 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:56.556628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dff27007-72d3-4e58-9977-0f98f0cf0985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:56.587681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5753b3b-3c84-48e2-8c24-1a04db74a0c6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:56.674741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572ee7e-1316-4ad7-850a-783e0653b4d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:56.676081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572ee7e-1316-4ad7-850a-783e0653b4d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.676366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572ee7e-1316-4ad7-850a-783e0653b4d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.676543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572ee7e-1316-4ad7-850a-783e0653b4d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.678561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2572ee7e-1316-4ad7-850a-783e0653b4d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:56.680464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff27007-72d3-4e58-9977-0f98f0cf0985 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:56.689137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199fa487-4a91-477e-b8a7-bbb7bc37b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:56.690697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fa487-4a91-477e-b8a7-bbb7bc37b58f admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.691164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fa487-4a91-477e-b8a7-bbb7bc37b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.691643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199fa487-4a91-477e-b8a7-bbb7bc37b58f admin admin] PATH_INFO: `/v3/projects/ddf75dba3913407cac173b259f779df2/users/a01c9fb261da4c96a042a9f47e1c75e4/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.696681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fa487-4a91-477e-b8a7-bbb7bc37b58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf75dba3913407cac173b259f779df2, user_id=a01c9fb261da4c96a042a9f47e1c75e4, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:56.702266 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199fa487-4a91-477e-b8a7-bbb7bc37b58f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:56.720531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 823/1645] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:16:56 2021] PUT /identity/v3/projects/ddf75dba3913407cac173b259f779df2/users/a01c9fb261da4c96a042a9f47e1c75e4/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:56.722831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca644ea-e1b2-4f93-84e1-9eb561bb159b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.723496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca644ea-e1b2-4f93-84e1-9eb561bb159b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.723968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca644ea-e1b2-4f93-84e1-9eb561bb159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.755445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8ca644ea-e1b2-4f93-84e1-9eb561bb159b None None] MFA Rules not processed for user `681c813529d941f688bff8333ad3b089`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:56.757320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8ca644ea-e1b2-4f93-84e1-9eb561bb159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:56.783666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572ee7e-1316-4ad7-850a-783e0653b4d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:56.785832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572ee7e-1316-4ad7-850a-783e0653b4d4 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:56.798111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 823/1646] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:56 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:56.799485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9726f5-eeba-4535-925d-61adb60a1683 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.799775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9726f5-eeba-4535-925d-61adb60a1683 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.800048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9726f5-eeba-4535-925d-61adb60a1683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.846978 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1f9726f5-eeba-4535-925d-61adb60a1683 None None] MFA Rules not processed for user `cda509ce8f8d4e478b68798ef7abda1a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:56.847982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1f9726f5-eeba-4535-925d-61adb60a1683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:56.865593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 824/1647] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:56 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:56.867196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.867533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.867866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:56.901362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:56.903424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:56.943099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 824/1648] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:56 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:56.944697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc69c-e4db-4bd8-a461-385a2b6cd11c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:56.945550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc69c-e4db-4bd8-a461-385a2b6cd11c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:56.945920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccc69c-e4db-4bd8-a461-385a2b6cd11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.004487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-53ccc69c-e4db-4bd8-a461-385a2b6cd11c None None] MFA Rules not processed for user `6d09511f0bb7411f9f8c06f49d3a5810`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:57.006021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-53ccc69c-e4db-4bd8-a461-385a2b6cd11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.011747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 825/1649] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:57.012946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.019525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.035089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b0596-6599-4303-b1cb-cc4f9037f27e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:57.042408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:57.043649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.044258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.044731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] PATH_INFO: `/v3/users/9dbe4dd4102d4702a72bc416fd2f7b53` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.047107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbe4dd4102d4702a72bc416fd2f7b53)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:57.050546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:57.074308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 825/1650] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:16:56 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:57.075093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.075394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.075706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.125147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] MFA Rules not processed for user `a01c9fb261da4c96a042a9f47e1c75e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:57.131107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.163883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbe4dd4102d4702a72bc416fd2f7b53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.164757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbe4dd4102d4702a72bc416fd2f7b53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.181846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbe4dd4102d4702a72bc416fd2f7b53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.204516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbe4dd4102d4702a72bc416fd2f7b53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.218117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbe4dd4102d4702a72bc416fd2f7b53'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.229461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 826/1651] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:16:57 2021] DELETE /identity/v3/users/9dbe4dd4102d4702a72bc416fd2f7b53 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:57.230887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.234449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.248994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 826/1652] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:57 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:57.250373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.252520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.354022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a29eb3-3146-405a-9a01-d8c304ef512a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:57.361647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5eeb-0d8c-4332-b9aa-8a4421bb7dc3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:57.370287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:57.372677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.372677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.372677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.375041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.434358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:57.435566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.436143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.436663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.439681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.452074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:57.453919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:57.473537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 827/1653] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:57 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:57.476063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.478109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.562074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:57.563750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:57.569544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ef504-43b8-43f5-8244-64e4c75cb7cb service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:57.578269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:57.579153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.579695 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.581924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.586632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.589521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 827/1654] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:57 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:57.591160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.605081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa20b-9d11-4668-ac1c-ab2124176799 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:57.611058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162bdc2-d1df-4635-b7af-745f9497fb9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:57.611416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bdc2-d1df-4635-b7af-745f9497fb9e service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.611796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bdc2-d1df-4635-b7af-745f9497fb9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.612161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bdc2-d1df-4635-b7af-745f9497fb9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.614324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3162bdc2-d1df-4635-b7af-745f9497fb9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.627471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162bdc2-d1df-4635-b7af-745f9497fb9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:57.629093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162bdc2-d1df-4635-b7af-745f9497fb9e service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:57.638642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 828/1655] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:57 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:57.640403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.640698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.641057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.671314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:57.673316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.764452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 829/1656] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:57.768807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.770488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.785444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49690ef-03fe-4000-b7be-ac3f57c20391 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:57.792037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:57.792879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.793168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.793477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] PATH_INFO: `/v3/users/2233ae9efa4a425b88f4653e357dd5f7` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.795388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:57.795589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2233ae9efa4a425b88f4653e357dd5f7)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:57.797632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:57.798141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:57.825860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 828/1657] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:57.830826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.833223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.854191 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56281195-d409-4aa6-84dd-eb14080b54f5 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:57.862902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:57.864282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:57.864705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:57.865188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] PATH_INFO: `/v3/users/6239fca79b7f4618ab2282126c412f35` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:57.866908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6239fca79b7f4618ab2282126c412f35)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:57.870438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:57.910542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2233ae9efa4a425b88f4653e357dd5f7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.912836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2233ae9efa4a425b88f4653e357dd5f7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.930489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2233ae9efa4a425b88f4653e357dd5f7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.949068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2233ae9efa4a425b88f4653e357dd5f7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.963726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2233ae9efa4a425b88f4653e357dd5f7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.980545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 830/1658] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:16:57 2021] DELETE /identity/v3/users/2233ae9efa4a425b88f4653e357dd5f7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:57.983179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:57.986773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:57.992447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6239fca79b7f4618ab2282126c412f35'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:57.994150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6239fca79b7f4618ab2282126c412f35'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.025535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6239fca79b7f4618ab2282126c412f35'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.041219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6239fca79b7f4618ab2282126c412f35'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.067346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f07de06-5632-4107-9411-3f5f6053abaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6239fca79b7f4618ab2282126c412f35'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.082016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 829/1659] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:16:57 2021] DELETE /identity/v3/users/6239fca79b7f4618ab2282126c412f35 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:58.084045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.084442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.084946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.107456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:58.109013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.149393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c189ff-bbb3-4ba3-baf0-5a5955fca7a9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:58.193937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 830/1660] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:58.195500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:58.197897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.211691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284db1f-7091-4a8a-841e-c730ffa3ad20 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:58.217460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:58.218316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.218698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.219710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] PATH_INFO: `/v3/users/def95d0599f54c7b9a9fc36ba1742387` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.220601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=def95d0599f54c7b9a9fc36ba1742387)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:58.223002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:58.274568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a758-690d-4120-afec-3d0ae32a8f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:58.276513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a758-690d-4120-afec-3d0ae32a8f0d service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.276513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a758-690d-4120-afec-3d0ae32a8f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.276929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a758-690d-4120-afec-3d0ae32a8f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.281361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3e33a758-690d-4120-afec-3d0ae32a8f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.303003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def95d0599f54c7b9a9fc36ba1742387'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.304472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def95d0599f54c7b9a9fc36ba1742387'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.307962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33a758-690d-4120-afec-3d0ae32a8f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:58.311328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33a758-690d-4120-afec-3d0ae32a8f0d service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:58.314342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def95d0599f54c7b9a9fc36ba1742387'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.335285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def95d0599f54c7b9a9fc36ba1742387'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.350842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 831/1661] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:58.355482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e2e2e-f462-4809-bb18-7c2ddcc9c23e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.360245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e2e2e-f462-4809-bb18-7c2ddcc9c23e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.360749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e2e2e-f462-4809-bb18-7c2ddcc9c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.363292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a41359d-c84e-4cd1-97b8-f8b8ff18ee2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def95d0599f54c7b9a9fc36ba1742387'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:58.390294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 831/1662] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:16:58 2021] DELETE /identity/v3/users/def95d0599f54c7b9a9fc36ba1742387 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:58.392412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de517d0-0d0d-4b3d-b7e5-9db0e3330982 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.392800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de517d0-0d0d-4b3d-b7e5-9db0e3330982 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.393153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de517d0-0d0d-4b3d-b7e5-9db0e3330982 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.396335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 832/1663] 10.222.0.31 () {54 vars in 912 bytes} [Tue Nov 16 03:16:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:16:58.397314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de517d0-0d0d-4b3d-b7e5-9db0e3330982 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:58.399407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5de517d0-0d0d-4b3d-b7e5-9db0e3330982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.411864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cd3e2e2e-f462-4809-bb18-7c2ddcc9c23e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:58.416359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cd3e2e2e-f462-4809-bb18-7c2ddcc9c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.503858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 832/1664] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:58.503858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea6c4d-a797-4f82-8dfc-ab9b2bb4e0b9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.503858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea6c4d-a797-4f82-8dfc-ab9b2bb4e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.503858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea6c4d-a797-4f82-8dfc-ab9b2bb4e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.528738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d8ea6c4d-a797-4f82-8dfc-ab9b2bb4e0b9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:58.530801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d8ea6c4d-a797-4f82-8dfc-ab9b2bb4e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.545467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 833/1665] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:58.547696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.548225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.548668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.571127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] MFA Rules not processed for user `6d09511f0bb7411f9f8c06f49d3a5810`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:58.572583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.581319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 834/1666] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:16:58 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:58.582253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de517d0-0d0d-4b3d-b7e5-9db0e3330982 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:58.592846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:58.593861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.595318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:58.597248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.598299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.598907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.605321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.627613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998708f3-9f79-4bc5-aeba-bcecfc016d73 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:58.645824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:58.647111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.647541 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.648109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.658705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:58.660341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:58.662137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:58.664377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:58.680379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 835/1667] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:58.681683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:58.687143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 833/1668] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:58.687592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:58.694248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac982c22-0bfd-40f4-8d62-9300bb12d73e service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:58.701258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:58.707067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.707396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2245f353-4340-4287-bfc4-fa4744b5c9f5 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:58.707585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.708808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.718054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:58.718744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.719029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.719303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.729654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:58.730339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:58.731136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:58.733845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:58.747808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 834/1669] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:58 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:58.750786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:58.753294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.766255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 836/1670] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:58.832725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a659f7-4fd1-40d5-a0f1-a47f200cf83f service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:58.846773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:58.850115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:58.850597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:58.851146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] PATH_INFO: `/v3/projects/7f645d0b0f2d40129324fcd5a61c2d1c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:58.854110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f645d0b0f2d40129324fcd5a61c2d1c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:58.861542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:58.923067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:58.924848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:58.987139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f645d0b0f2d40129324fcd5a61c2d1c', 'request_id': 'req-596e473d-b3ff-44a9-9cf9-dadfec451d38'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.000298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f645d0b0f2d40129324fcd5a61c2d1c', 'request_id': 'req-596e473d-b3ff-44a9-9cf9-dadfec451d38'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.013905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f645d0b0f2d40129324fcd5a61c2d1c', 'request_id': 'req-596e473d-b3ff-44a9-9cf9-dadfec451d38'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.044876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] The token cache is being invalidate because project 7f645d0b0f2d40129324fcd5a61c2d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:16:59.045408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.046646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-596e473d-b3ff-44a9-9cf9-dadfec451d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.055216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 835/1671] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:16:58 2021] DELETE /identity/v3/projects/7f645d0b0f2d40129324fcd5a61c2d1c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:16:59.058219 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b32a69-dd1b-4c88-95e0-30f12a096bb6 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.059793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad342-aa0e-4434-af9d-9ef643e710a8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.060986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad342-aa0e-4434-af9d-9ef643e710a8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.061497 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad342-aa0e-4434-af9d-9ef643e710a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.119632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6daad342-aa0e-4434-af9d-9ef643e710a8 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:59.121741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6daad342-aa0e-4434-af9d-9ef643e710a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:59.190390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c32a6-705e-401d-bc4b-4eae5c5b3c80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.192230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c32a6-705e-401d-bc4b-4eae5c5b3c80 service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.192713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c32a6-705e-401d-bc4b-4eae5c5b3c80 service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.193155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c32a6-705e-401d-bc4b-4eae5c5b3c80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.196327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-736c32a6-705e-401d-bc4b-4eae5c5b3c80 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:59.217932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c32a6-705e-401d-bc4b-4eae5c5b3c80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.220104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c32a6-705e-401d-bc4b-4eae5c5b3c80 service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:59.234948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 837/1672] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:16:58 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:16:59.268464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 836/1673] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:59.280739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c614bc-0039-4cc5-87ca-6404c5a429db None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.281264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c614bc-0039-4cc5-87ca-6404c5a429db None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.281627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c614bc-0039-4cc5-87ca-6404c5a429db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.322037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-37c614bc-0039-4cc5-87ca-6404c5a429db None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:16:59.324394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-37c614bc-0039-4cc5-87ca-6404c5a429db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:59.345119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 838/1674] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:16:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:16:59.348288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daad342-aa0e-4434-af9d-9ef643e710a8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:59.367157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daad342-aa0e-4434-af9d-9ef643e710a8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.379464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.383412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.383806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.384098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.385089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:16:59.385405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.391316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:59.417894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 837/1675] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:16:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:16:59.424555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c614bc-0039-4cc5-87ca-6404c5a429db None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:59.436828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c614bc-0039-4cc5-87ca-6404c5a429db None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.455349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.456995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.457387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.457715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.458718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.462654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:59.489894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:59.492761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:59.532488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e72d6c-aeeb-479c-989e-eed9f36e4a7b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.539960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.541187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.541703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.543156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] PATH_INFO: `/v3/projects/cfee12c8cac74d1ea51217408535dc62` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.543728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfee12c8cac74d1ea51217408535dc62)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.548001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:59.560118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 839/1676] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:16:59 2021] POST /identity/v3/projects => generated 401 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:59.566644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:59.621780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfee12c8cac74d1ea51217408535dc62', 'request_id': 'req-61c074a2-0cbb-4ec8-a862-5bd77acba484'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.634777 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfee12c8cac74d1ea51217408535dc62', 'request_id': 'req-61c074a2-0cbb-4ec8-a862-5bd77acba484'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.649488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfee12c8cac74d1ea51217408535dc62', 'request_id': 'req-61c074a2-0cbb-4ec8-a862-5bd77acba484'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.675331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] The token cache is being invalidate because project cfee12c8cac74d1ea51217408535dc62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:16:59.675573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.676577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.681724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 838/1677] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:16:59 2021] DELETE /identity/v3/projects/cfee12c8cac74d1ea51217408535dc62 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:16:59.688606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:59.698909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:59.730707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f78bb5-66ac-4a65-8ca9-4ccb2e422805 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.823718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c074a2-0cbb-4ec8-a862-5bd77acba484 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.831872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.832590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.832978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.833358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] PATH_INFO: `/v3/users/cda509ce8f8d4e478b68798ef7abda1a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.839449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda509ce8f8d4e478b68798ef7abda1a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.843457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:59.846474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.849416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.849416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.849416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.849787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.852562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:59.886931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 840/1678] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:16:59 2021] POST /identity/v3/users => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:16:59.892067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:59.896213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:16:59.914976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a587a-f026-40ad-9469-7a172831549c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.924472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.925410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.925915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.926198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.929498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.934339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:16:59.948867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 841/1679] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:59 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:16:59.953028 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:16:59.966407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda509ce8f8d4e478b68798ef7abda1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.967824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda509ce8f8d4e478b68798ef7abda1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.971830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1955d-6127-48b3-850a-946c82081888 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:16:59.981012 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda509ce8f8d4e478b68798ef7abda1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:16:59.983316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:16:59.984133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:16:59.984574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:16:59.985355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:16:59.986438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:16:59.997600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:00.027869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda509ce8f8d4e478b68798ef7abda1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:00.040556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 842/1680] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:16:59 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:00.046962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:00.054821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cd9bd2e5-5e5b-4646-ba54-fad615332e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda509ce8f8d4e478b68798ef7abda1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:00.069696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 839/1681] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:16:59 2021] DELETE /identity/v3/users/cda509ce8f8d4e478b68798ef7abda1a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:00.077240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68fb6e-7e78-486a-82aa-66a8a9103bfc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:00.331101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:00.333280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:00.334208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:00.335015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] PATH_INFO: `/v3/projects/97e68b408d034c0c8857be85e3ca59f5/users/75a39af0ff22404890821f02cac85e81/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:00.390746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e68b408d034c0c8857be85e3ca59f5, user_id=75a39af0ff22404890821f02cac85e81, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:00.401317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:00.443785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:00.444296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:00.444676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:00.449866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 843/1682] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:00 2021] PUT /identity/v3/projects/97e68b408d034c0c8857be85e3ca59f5/users/75a39af0ff22404890821f02cac85e81/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:00.477961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:00.479601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:00.522765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:00.526970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:00.661728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 840/1683] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:00.677789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:00.679415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:00.749166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc155750-9376-47cc-8c99-76596556190f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:00.793266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:00.805580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439de44-28f6-48c6-94e3-a266cb708bd1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:00.805937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:00.805937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:00.805937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] PATH_INFO: `/v3/projects/12882c2b76424e97b392e96c1a834ed9` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:00.805937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12882c2b76424e97b392e96c1a834ed9)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:00.822418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:00.825931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:00.826440 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:00.841670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:00.844719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: WARNING py.warnings [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 16 03:17:00.844719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: warnings.warn(msg) Nov 16 03:17:00.844719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: Nov 16 03:17:00.848086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:00.865528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:00.876485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:00.897353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 841/1684] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:17:00.898210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:00.899989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:00.930117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413473f-0e92-44d8-a11d-f88ef4387777 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:00.935585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:00.937268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:00.937445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:00.938410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] PATH_INFO: `/v3/projects/8be11fc7db6b418cba9a8f29d90162ee` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:00.939308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be11fc7db6b418cba9a8f29d90162ee)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:00.943016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:01.050384 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12882c2b76424e97b392e96c1a834ed9', 'request_id': 'req-30e30a87-dd12-4a88-bf53-17efd6060c69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.092859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12882c2b76424e97b392e96c1a834ed9', 'request_id': 'req-30e30a87-dd12-4a88-bf53-17efd6060c69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.094718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be11fc7db6b418cba9a8f29d90162ee', 'request_id': 'req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.119813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be11fc7db6b418cba9a8f29d90162ee', 'request_id': 'req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.122339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12882c2b76424e97b392e96c1a834ed9', 'request_id': 'req-30e30a87-dd12-4a88-bf53-17efd6060c69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.174823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be11fc7db6b418cba9a8f29d90162ee', 'request_id': 'req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.199080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] The token cache is being invalidate because project 12882c2b76424e97b392e96c1a834ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:01.199080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.199080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.210580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 844/1685] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:00 2021] DELETE /identity/v3/projects/12882c2b76424e97b392e96c1a834ed9 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:01.215817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:01.218603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] The token cache is being invalidate because project 8be11fc7db6b418cba9a8f29d90162ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:01.220146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:01.220897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.242893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0689319c-7b21-4cfb-ac6b-b9543ad5f4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.257654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 842/1686] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:00 2021] DELETE /identity/v3/projects/8be11fc7db6b418cba9a8f29d90162ee => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:01.260347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433498-006c-47d3-ae53-2dfe5893b60a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:01.260856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433498-006c-47d3-ae53-2dfe5893b60a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:01.261348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87433498-006c-47d3-ae53-2dfe5893b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:01.321192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-87433498-006c-47d3-ae53-2dfe5893b60a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:01.331992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-87433498-006c-47d3-ae53-2dfe5893b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:01.427658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e30a87-dd12-4a88-bf53-17efd6060c69 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:01.488504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 843/1687] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:01.508926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:01.509365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:01.509991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:01.593888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:01.596125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:01.624837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 844/1688] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:01.631402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:01.640384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:01.681995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63795150-aefd-4ac0-a052-7d2dfd5655c5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:01.703538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:01.711570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:01.712003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:01.712398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] PATH_INFO: `/v3/projects/56aae1d7526145a0b92518c507f24343` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:01.718116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:01.723431 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:01.723645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aae1d7526145a0b92518c507f24343)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:01.724420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:01.724702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] PATH_INFO: `/v3/users/d47234b01d59478bb90346ec884717df` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:01.725761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:01.729871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d47234b01d59478bb90346ec884717df)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:01.739352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:01.883931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd47234b01d59478bb90346ec884717df'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.885311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aae1d7526145a0b92518c507f24343', 'request_id': 'req-868ce7ce-9764-4bff-8bcb-92b715a02bc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.888943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd47234b01d59478bb90346ec884717df'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.905095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd47234b01d59478bb90346ec884717df'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.917176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aae1d7526145a0b92518c507f24343', 'request_id': 'req-868ce7ce-9764-4bff-8bcb-92b715a02bc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.943782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd47234b01d59478bb90346ec884717df'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.949143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aae1d7526145a0b92518c507f24343', 'request_id': 'req-868ce7ce-9764-4bff-8bcb-92b715a02bc1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.959106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd47234b01d59478bb90346ec884717df'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.977236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 845/1689] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:01 2021] DELETE /identity/v3/users/d47234b01d59478bb90346ec884717df => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:01.978240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:01.979383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] The token cache is being invalidate because project 56aae1d7526145a0b92518c507f24343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:01.980048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.982733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:01.983328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:01.989130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 845/1690] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:01 2021] DELETE /identity/v3/projects/56aae1d7526145a0b92518c507f24343 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:01.993273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:02.002068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:02.215996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e747c88-4921-4f3a-9a52-176fee61c6ce admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:02.243184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ce7ce-9764-4bff-8bcb-92b715a02bc1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:02.245820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:02.246857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:02.248592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:02.249367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] PATH_INFO: `/v3/projects/e4d221503ed04c31b9199525233a4bdc` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:02.252007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d221503ed04c31b9199525233a4bdc)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:02.254663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:02.255397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:02.255681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:02.255960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:02.261240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:02.261598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:02.265313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:02.267181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:02.294772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 846/1691] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:02.303714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:02.306248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:02.321667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c75176-572f-4c2f-a598-fc9c1747d16d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:02.327862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:02.329233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:02.329767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:02.330039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] PATH_INFO: `/v3/users/a01c9fb261da4c96a042a9f47e1c75e4` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:02.331904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01c9fb261da4c96a042a9f47e1c75e4)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:02.334207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:02.429733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01c9fb261da4c96a042a9f47e1c75e4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.436794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01c9fb261da4c96a042a9f47e1c75e4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.437333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d221503ed04c31b9199525233a4bdc', 'request_id': 'req-cc05845e-1adc-4d04-b119-6b8a5eb8443d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.457510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01c9fb261da4c96a042a9f47e1c75e4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.460626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d221503ed04c31b9199525233a4bdc', 'request_id': 'req-cc05845e-1adc-4d04-b119-6b8a5eb8443d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.474856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d221503ed04c31b9199525233a4bdc', 'request_id': 'req-cc05845e-1adc-4d04-b119-6b8a5eb8443d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.509866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] The token cache is being invalidate because project e4d221503ed04c31b9199525233a4bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:02.509866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.509866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.509866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 846/1692] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:01 2021] DELETE /identity/v3/projects/e4d221503ed04c31b9199525233a4bdc => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:02.509866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:02.515874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:02.519244 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01c9fb261da4c96a042a9f47e1c75e4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.549752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01c9fb261da4c96a042a9f47e1c75e4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:02.601524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 847/1693] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:02 2021] DELETE /identity/v3/users/a01c9fb261da4c96a042a9f47e1c75e4 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:02.620973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:02.637157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:02.642820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05845e-1adc-4d04-b119-6b8a5eb8443d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:02.725818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:02.726728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:02.727428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:02.727428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:02.728509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:02.731201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:02.781851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 847/1694] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:02 2021] POST /identity/v3/projects => generated 409 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:02.785033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:02.790090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:02.992356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a5cc0-1c34-41d2-a7ad-73bbfda6d644 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:03.061139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36547e96-d405-4839-ac92-b9c39dc6e4c6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:03.070149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:03.071036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:03.071355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:03.071638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:03.073022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:03.076321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:03.109998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 848/1695] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:02 2021] POST /identity/v3/users => generated 305 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:03.114535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:03.155841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405dde9-2eb7-427a-b545-f66044369fde admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:03.172540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f2fd5-f8a2-4fa3-8f07-3892ff41fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:03.173612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2fd5-f8a2-4fa3-8f07-3892ff41fb7b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:03.175481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2fd5-f8a2-4fa3-8f07-3892ff41fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:03.176085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f2fd5-f8a2-4fa3-8f07-3892ff41fb7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:03.177225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f2fd5-f8a2-4fa3-8f07-3892ff41fb7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:03.180161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7f2fd5-f8a2-4fa3-8f07-3892ff41fb7b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:03.194629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 849/1696] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:03 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:03.203278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdde58-49b3-453c-b7d3-b405434b4a07 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:03.204015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdde58-49b3-453c-b7d3-b405434b4a07 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:03.204538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdde58-49b3-453c-b7d3-b405434b4a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:03.215384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:03.219819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:03.220550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:03.221187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] PATH_INFO: `/v3/users/1a8bc853873c46f68181bd7c4ea7a318` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:03.224336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8bc853873c46f68181bd7c4ea7a318)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:03.234126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cdcdde58-49b3-453c-b7d3-b405434b4a07 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:03.234723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:03.236577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cdcdde58-49b3-453c-b7d3-b405434b4a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:03.383818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8bc853873c46f68181bd7c4ea7a318'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:03.389838 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8bc853873c46f68181bd7c4ea7a318'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:03.422039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8bc853873c46f68181bd7c4ea7a318'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:03.439035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 850/1697] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:17:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:03.448089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdde58-49b3-453c-b7d3-b405434b4a07 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:03.481216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8bc853873c46f68181bd7c4ea7a318'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:03.513061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdde58-49b3-453c-b7d3-b405434b4a07 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:03.517847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-334498c1-401d-413b-94fa-09ac8a7f7947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8bc853873c46f68181bd7c4ea7a318'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:03.550242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 848/1698] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:02 2021] DELETE /identity/v3/users/1a8bc853873c46f68181bd7c4ea7a318 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:03.551670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:03.551965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:03.552238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:03.561236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:03.568164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:03.568376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:03.568657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:03.571923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:03.582813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:03.634427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 851/1699] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:03 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:03.634427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:03.640052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:03.675139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] MFA Rules not processed for user `75a39af0ff22404890821f02cac85e81`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:03.676439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:03.697302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a8638-2937-41fc-b42f-49074b1a98ed admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:03.957929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:03.959166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:03.959613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:03.960238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] PATH_INFO: `/v3/projects/aaccbdb35286412a883c7cd4bbb09535` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:03.962473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaccbdb35286412a883c7cd4bbb09535)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:03.965553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:04.018274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 849/1700] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:03 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:04.019262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:04.020847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.046504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf8bdc-1878-4b10-9b8e-9e44065f7bb6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:04.047422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaccbdb35286412a883c7cd4bbb09535', 'request_id': 'req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.062200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaccbdb35286412a883c7cd4bbb09535', 'request_id': 'req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.070863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaccbdb35286412a883c7cd4bbb09535', 'request_id': 'req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.093329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] The token cache is being invalidate because project aaccbdb35286412a883c7cd4bbb09535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:04.094042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.096624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.109596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 852/1701] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:03 2021] DELETE /identity/v3/projects/aaccbdb35286412a883c7cd4bbb09535 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:04.111941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:04.118606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.177683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:04.178763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.179847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.179847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] PATH_INFO: `/v3/projects/ddf75dba3913407cac173b259f779df2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:04.181805 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf75dba3913407cac173b259f779df2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:04.185814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:04.274924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf75dba3913407cac173b259f779df2', 'request_id': 'req-b96b3cab-334f-404a-8609-0f5877d20700'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.285943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3be8c2-0b0c-4bdf-af22-d02259e9d014 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:04.288138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf75dba3913407cac173b259f779df2', 'request_id': 'req-b96b3cab-334f-404a-8609-0f5877d20700'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.296221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf75dba3913407cac173b259f779df2', 'request_id': 'req-b96b3cab-334f-404a-8609-0f5877d20700'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.319998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] The token cache is being invalidate because project ddf75dba3913407cac173b259f779df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:04.320271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.321488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.325566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 850/1702] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:04 2021] DELETE /identity/v3/projects/ddf75dba3913407cac173b259f779df2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:04.326739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:04.329237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.373386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:04.374584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.374872 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.375157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] PATH_INFO: `/v3/projects/c22a86d172c84517b5f8528001888380/users/2dd96ca165554c9ea98222f27a8fb8de/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:04.391425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22a86d172c84517b5f8528001888380, user_id=2dd96ca165554c9ea98222f27a8fb8de, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:04.394293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:04.410453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 853/1703] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:04 2021] PUT /identity/v3/projects/c22a86d172c84517b5f8528001888380/users/2dd96ca165554c9ea98222f27a8fb8de/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:04.411496 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:04.413657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.428625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b3cab-334f-404a-8609-0f5877d20700 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:04.507319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9589736b-6bdf-42b0-85c2-4470062957d1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:04.513522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f539c13-6d6f-4d7d-9cd1-1a7f47af6867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:04.514435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539c13-6d6f-4d7d-9cd1-1a7f47af6867 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.514729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539c13-6d6f-4d7d-9cd1-1a7f47af6867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.515227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f539c13-6d6f-4d7d-9cd1-1a7f47af6867 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:04.516512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f539c13-6d6f-4d7d-9cd1-1a7f47af6867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:04.518427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f539c13-6d6f-4d7d-9cd1-1a7f47af6867 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:04.552998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 854/1704] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:04 2021] POST /identity/v3/projects => generated 405 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:04.558626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7d33-f395-4795-b2cf-52c0814370f9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.558626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7d33-f395-4795-b2cf-52c0814370f9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.558626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b7d33-f395-4795-b2cf-52c0814370f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:04.562827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:04.563631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.563931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.564259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:04.566310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.581813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e04b7d33-f395-4795-b2cf-52c0814370f9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:04.583691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e04b7d33-f395-4795-b2cf-52c0814370f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.651675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:04.655763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:04.674632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 851/1705] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:17:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:17:04.683576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:04.685231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.701309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211fd55-1463-42c0-b93c-ba9fba0d7342 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:04.718050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 855/1706] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:04.718230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:04.718392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.718534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.718704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.718849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.718849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] PATH_INFO: `/v3/projects/d6106de212c64a39b58588b6e2bd05c2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:04.719326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:04.719459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6106de212c64a39b58588b6e2bd05c2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:04.719459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:04.792283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:04.795885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:04.838379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6106de212c64a39b58588b6e2bd05c2', 'request_id': 'req-cc98895e-fed7-44f1-ac3c-e5658b730596'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.861006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6106de212c64a39b58588b6e2bd05c2', 'request_id': 'req-cc98895e-fed7-44f1-ac3c-e5658b730596'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.881776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6106de212c64a39b58588b6e2bd05c2', 'request_id': 'req-cc98895e-fed7-44f1-ac3c-e5658b730596'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.910214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] The token cache is being invalidate because project d6106de212c64a39b58588b6e2bd05c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:04.910547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.915336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-cc98895e-fed7-44f1-ac3c-e5658b730596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:04.922400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 852/1707] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:04 2021] DELETE /identity/v3/projects/d6106de212c64a39b58588b6e2bd05c2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:04.926140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0f64-b610-4e6f-860a-2376a27a57a7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:04.926565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0f64-b610-4e6f-860a-2376a27a57a7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:04.926741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca0f64-b610-4e6f-860a-2376a27a57a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.010065 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0cca0f64-b610-4e6f-860a-2376a27a57a7 None None] MFA Rules not processed for user `2dd96ca165554c9ea98222f27a8fb8de`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:05.011368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0cca0f64-b610-4e6f-860a-2376a27a57a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:05.154258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 856/1708] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:05.183403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 853/1709] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:04 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:05.192200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689241-462d-40c3-babb-922a3c5dc5ba None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.192508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:05.192703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689241-462d-40c3-babb-922a3c5dc5ba None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.192981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689241-462d-40c3-babb-922a3c5dc5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.200637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:05.230712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4b689241-462d-40c3-babb-922a3c5dc5ba None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:05.232113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4b689241-462d-40c3-babb-922a3c5dc5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:05.261206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 854/1710] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:05.261206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.261206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.262018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70e16e-43c0-4614-86d0-e20a15a74a88 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:05.262172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.290475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faccbe-1b96-4a93-9266-12e9e608094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:05.291714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faccbe-1b96-4a93-9266-12e9e608094f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.292222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faccbe-1b96-4a93-9266-12e9e608094f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.292707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faccbe-1b96-4a93-9266-12e9e608094f admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.300256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:05.301687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:05.304043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faccbe-1b96-4a93-9266-12e9e608094f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:05.310075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faccbe-1b96-4a93-9266-12e9e608094f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:05.328346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 855/1711] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:05.328346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:05.330781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:05.360375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122c1da-197e-42eb-9215-c1e390cadb86 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:05.371925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 857/1712] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/users => generated 309 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:05.373927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:05.374618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.374906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.375183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.376029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:05.378646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:05.383804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f09f-a415-433b-97c8-4d4f1924fade None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.384309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f09f-a415-433b-97c8-4d4f1924fade None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.385414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f09f-a415-433b-97c8-4d4f1924fade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.444713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 856/1713] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:05.445785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:05.489531 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6252f09f-a415-433b-97c8-4d4f1924fade None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:05.492288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6252f09f-a415-433b-97c8-4d4f1924fade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:05.656305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e0a47-132d-4905-8ee1-473481db1cd7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:05.665651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3853e615-d3ca-4a45-9013-a59280e5b2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:05.667200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e615-d3ca-4a45-9013-a59280e5b2cf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.667905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e615-d3ca-4a45-9013-a59280e5b2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.668620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3853e615-d3ca-4a45-9013-a59280e5b2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.673949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e615-d3ca-4a45-9013-a59280e5b2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:05.679425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e615-d3ca-4a45-9013-a59280e5b2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:05.685898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3853e615-d3ca-4a45-9013-a59280e5b2cf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:05.768643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 857/1714] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:05.768643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccee6d-639c-4990-9f27-94d78d575303 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.768643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccee6d-639c-4990-9f27-94d78d575303 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.768643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ccee6d-639c-4990-9f27-94d78d575303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.801805 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d5ccee6d-639c-4990-9f27-94d78d575303 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:05.803123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d5ccee6d-639c-4990-9f27-94d78d575303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:05.829275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 858/1715] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:05.834682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccee6d-639c-4990-9f27-94d78d575303 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:05.846032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ccee6d-639c-4990-9f27-94d78d575303 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:05.862259 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 858/1716] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:05.863795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252f09f-a415-433b-97c8-4d4f1924fade None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:05.868977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:05.878259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.878259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.878259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.878259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:05.878259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:05.903914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 859/1717] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:05 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:05.904256 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:05.923350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252f09f-a415-433b-97c8-4d4f1924fade None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:05.932540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:05.933895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:05.936320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:05.936320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:05.937504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:05.969233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:05.976457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adc01b-46e7-4749-bedc-61aa550836cd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:06.005226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:06.006812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:06.007367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:06.008040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:06.010270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:06.016799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:06.035592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 859/1718] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:06.036271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.059623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a1ab2-b78a-48dd-ad64-ce238192fe0f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:06.079506 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:06.080426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:06.080716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:06.081211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:06.082594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:06.082948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:06.084749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:06.097913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 860/1719] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:05 2021] POST /identity/v3/projects => generated 357 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:06.099739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.126401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 860/1720] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:06.127428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.161287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82dd88-6321-4013-9ef3-3a554d458e74 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:06.325196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13724b52-5cd3-4fa4-ab1f-896f224f1944 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:06.339010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:06.342830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:06.343520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:06.344142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] PATH_INFO: `/v3/projects/cb501663d9634cfcbb8766c325f9229d/users/a5f9454bb4b24ce0acffefe1a316da73/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:06.345220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:06.358091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:06.358976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:06.360173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:06.376097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:06.383104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:06.385180 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb501663d9634cfcbb8766c325f9229d, user_id=a5f9454bb4b24ce0acffefe1a316da73, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:06.388943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:06.405088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:06.420965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 861/1721] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:06 2021] PUT /identity/v3/projects/cb501663d9634cfcbb8766c325f9229d/users/a5f9454bb4b24ce0acffefe1a316da73/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:06.423432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.474886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 861/1722] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:06.474886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.537143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dc8856-a2e9-4196-b135-871416b5b068 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:06.675737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcbc93a-9913-4d3c-ba26-57822e4d98b4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:06.692982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:06.694574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:06.696352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:06.697039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:06.697799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:06.701595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:06.713735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:06.716380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:06.717498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:06.718236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:06.720033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:06.727891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:06.737204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 862/1723] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:06 2021] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:06.738311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.764135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940f81f-1889-4aad-9957-4f3bc2656d1d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:06.785019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:06.785922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:06.786313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:06.786691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:06.787537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:06.789716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:06.873422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 862/1724] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:06 2021] POST /identity/v3/users => generated 279 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:06.875660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.886353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 863/1725] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:06 2021] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:06.891760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:06.898779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73841ce7-0e7b-4878-9e4c-3f646ff63f5d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.029790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecf0be-2253-4bb1-8309-228e2d12edae admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.031167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.032354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.032836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.033560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.035754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.039936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.042005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.046434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.047340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.047615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.048841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.050766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.085392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 863/1726] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:06 2021] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:07.090447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:07.109362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc14a8-d291-40f2-83dd-8e0d7644fbaf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.119562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.120941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.121411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.121984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] PATH_INFO: `/v3/projects/64648c2b44cd4cb6a14f0a1313bb2343/users/4fd3c571182e48959248caec995306a2/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.133282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 864/1727] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:06 2021] POST /identity/v3/projects => generated 363 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:07.133282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:07.153697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64648c2b44cd4cb6a14f0a1313bb2343, user_id=4fd3c571182e48959248caec995306a2, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.164796 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.197563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 864/1728] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:07 2021] PUT /identity/v3/projects/64648c2b44cd4cb6a14f0a1313bb2343/users/4fd3c571182e48959248caec995306a2/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:07.199219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:07.307220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1c6f3e-1736-4e8f-885a-fcdb06a734b4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.402875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec34f4-0870-4261-8fab-e7f6d6f008c1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.426624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.427344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.427634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.427912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.429679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.432433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.488040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.490730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.491757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.492711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.494854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.500013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.502880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 865/1729] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:07 2021] POST /identity/v3/users => generated 282 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:07.504691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:07.524413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 865/1730] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:07.526315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:07.545909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1b6a1-7cc8-40a7-987a-fb655b5fd628 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.548890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6417e5-0000-4921-a610-e739c60e3baa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.552846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.555142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.555142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.555142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.556230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.561406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.575085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022927af-8a28-447f-9c2a-e2a639164547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.577952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022927af-8a28-447f-9c2a-e2a639164547 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.637760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022927af-8a28-447f-9c2a-e2a639164547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.637760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022927af-8a28-447f-9c2a-e2a639164547 admin admin] PATH_INFO: `/v3/projects/cb501663d9634cfcbb8766c325f9229d/users/a5f9454bb4b24ce0acffefe1a316da73/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.638047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 866/1731] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:07 2021] POST /identity/v3/users => generated 282 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:07.638047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:07.638151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022927af-8a28-447f-9c2a-e2a639164547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb501663d9634cfcbb8766c325f9229d, user_id=a5f9454bb4b24ce0acffefe1a316da73, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.638151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022927af-8a28-447f-9c2a-e2a639164547 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.638271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8248aaf-5b58-4b75-aa86-0be5d6e8182b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.656867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:07.658156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.658696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.662882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.664994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:07.668637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:07.678231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 866/1732] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:07 2021] PUT /identity/v3/projects/cb501663d9634cfcbb8766c325f9229d/users/a5f9454bb4b24ce0acffefe1a316da73/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:07.682302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddc8f1-a56c-4263-8d8a-719e2755e8ef None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:07.682799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddc8f1-a56c-4263-8d8a-719e2755e8ef None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:07.683320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ddc8f1-a56c-4263-8d8a-719e2755e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:07.732206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 867/1733] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:07.734554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:07.779632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-70ddc8f1-a56c-4263-8d8a-719e2755e8ef None None] MFA Rules not processed for user `1f1edff84d4e4fc99dd8158012f3e77d`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:07.783160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-70ddc8f1-a56c-4263-8d8a-719e2755e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:07.788221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ade419-36d4-4519-9372-d1f10f652ed8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:07.931386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 867/1734] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:07 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:07.932551 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddc8f1-a56c-4263-8d8a-719e2755e8ef None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:08.043912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e7ea-39b4-4788-ad4b-c7b1b9b1ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:08.047380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e7ea-39b4-4788-ad4b-c7b1b9b1ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.047933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e7ea-39b4-4788-ad4b-c7b1b9b1ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.049472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e7ea-39b4-4788-ad4b-c7b1b9b1ecf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.049944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1e7ea-39b4-4788-ad4b-c7b1b9b1ecf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:08.062601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ddc8f1-a56c-4263-8d8a-719e2755e8ef None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:08.076075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:08.077196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.079351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.079848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.080925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:08.083964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:08.084125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1e7ea-39b4-4788-ad4b-c7b1b9b1ecf4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:08.109114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 868/1735] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:08.110059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:08.133337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961cfc5-8278-45fd-a0d4-08ba747176fc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:08.146711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:08.157244 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.162272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.162720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.163748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:08.165628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:08.186151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 869/1736] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:08 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:08.186677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 868/1737] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:08.189274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:08.196544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c60d-0749-4aed-9bf7-30e696f7585a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.202088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c60d-0749-4aed-9bf7-30e696f7585a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.204594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c60d-0749-4aed-9bf7-30e696f7585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.234029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c8734-b91d-4bd1-99bf-e05a5c3362ac admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:08.252438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:08.255116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.257966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.259099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] PATH_INFO: `/v3/projects/64648c2b44cd4cb6a14f0a1313bb2343/users/4fd3c571182e48959248caec995306a2/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.269294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64648c2b44cd4cb6a14f0a1313bb2343, user_id=4fd3c571182e48959248caec995306a2, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:08.281646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:08.308473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ad37c60d-0749-4aed-9bf7-30e696f7585a None None] MFA Rules not processed for user `1f1edff84d4e4fc99dd8158012f3e77d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:08.312056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad37c60d-0749-4aed-9bf7-30e696f7585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:08.319788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 870/1738] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:08 2021] PUT /identity/v3/projects/64648c2b44cd4cb6a14f0a1313bb2343/users/4fd3c571182e48959248caec995306a2/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:08.339287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:08.506644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb5bd9-8338-4bc9-a213-8070fca49103 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:08.519587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:08.520715 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.521143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.521555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] PATH_INFO: `/v3/projects/24d7bf61135a459f987182c30fb995ac/users/e28dc2c404e344c192ff6a49f02f0b61/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.563711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 869/1739] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:08 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:08.563711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37c60d-0749-4aed-9bf7-30e696f7585a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:08.564420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d7bf61135a459f987182c30fb995ac, user_id=e28dc2c404e344c192ff6a49f02f0b61, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:08.569026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:08.623735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37c60d-0749-4aed-9bf7-30e696f7585a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:08.625598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 871/1740] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:08 2021] PUT /identity/v3/projects/24d7bf61135a459f987182c30fb995ac/users/e28dc2c404e344c192ff6a49f02f0b61/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:08.627410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:08.938960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed42fd3-6fd2-43e7-a40f-e216405b3b84 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:08.972221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e749f67-024d-4fc3-83dd-fe33f98ad8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:08.976205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e749f67-024d-4fc3-83dd-fe33f98ad8ed admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.982059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e749f67-024d-4fc3-83dd-fe33f98ad8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.982703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e749f67-024d-4fc3-83dd-fe33f98ad8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.984045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e749f67-024d-4fc3-83dd-fe33f98ad8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:08.990547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e749f67-024d-4fc3-83dd-fe33f98ad8ed admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:08.992574 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a3e46-97f4-4ddf-8063-b30682cfcbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:08.993860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3e46-97f4-4ddf-8063-b30682cfcbed admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:08.994383 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3e46-97f4-4ddf-8063-b30682cfcbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:08.994884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3e46-97f4-4ddf-8063-b30682cfcbed admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:08.997404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a3e46-97f4-4ddf-8063-b30682cfcbed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:09.007485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a3e46-97f4-4ddf-8063-b30682cfcbed admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:09.029765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 872/1741] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:08 2021] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:09.031591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221bcd9-4d2d-49cb-9850-6cb2281d99cf None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:09.034711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221bcd9-4d2d-49cb-9850-6cb2281d99cf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:09.035297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221bcd9-4d2d-49cb-9850-6cb2281d99cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:09.052412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 870/1742] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:08 2021] GET /identity/v3/roles => generated 1420 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:09.058465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:09.058907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:09.059210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:09.097310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5221bcd9-4d2d-49cb-9850-6cb2281d99cf None None] MFA Rules not processed for user `6d09511f0bb7411f9f8c06f49d3a5810`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:09.101725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5221bcd9-4d2d-49cb-9850-6cb2281d99cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:09.130563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] MFA Rules not processed for user `4fd3c571182e48959248caec995306a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:09.133719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:09.199019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 873/1743] 10.222.0.11 () {58 vars in 1015 bytes} [Tue Nov 16 03:17:09 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:09.200750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd170-c935-4e54-bbac-15ef81f6700b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:09.201231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd170-c935-4e54-bbac-15ef81f6700b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:09.201653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd170-c935-4e54-bbac-15ef81f6700b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:09.256264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-9eacd170-c935-4e54-bbac-15ef81f6700b None None] MFA Rules not processed for user `e28dc2c404e344c192ff6a49f02f0b61`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:09.257914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9eacd170-c935-4e54-bbac-15ef81f6700b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:09.337277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 871/1744] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:09 2021] POST /identity/v3/auth/tokens => generated 3343 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:09.338306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:09.345866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:09.380849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 874/1745] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:09 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:09.381865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd170-c935-4e54-bbac-15ef81f6700b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:09.398102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd170-c935-4e54-bbac-15ef81f6700b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:09.403956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:09.406755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:09.407302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:09.407602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] PATH_INFO: `/v3/projects/ab22b9d09ed14f7e8b926f320a972894/users/f15af8a0192c4ca38a91f23d339bde20/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:09.447275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab22b9d09ed14f7e8b926f320a972894, user_id=f15af8a0192c4ca38a91f23d339bde20, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:09.454820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:09.492407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 875/1746] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:09 2021] PUT /identity/v3/projects/ab22b9d09ed14f7e8b926f320a972894/users/f15af8a0192c4ca38a91f23d339bde20/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:09.494737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:09.538281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432500-47eb-45ec-a7ee-62b47b8e8039 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:09.633142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69d93c-acf9-4bdf-a30e-f17eb5bc3f67 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:09.640080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:09.653986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:09.653986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:09.653986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] PATH_INFO: `/v3/projects/12f98077e5004f4e9b87c0c322eab5d9/users/acc8572befc74a568342003686b4b1f2/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:09.665073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f98077e5004f4e9b87c0c322eab5d9, user_id=acc8572befc74a568342003686b4b1f2, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:09.666087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:09.690517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 876/1747] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:09 2021] PUT /identity/v3/projects/12f98077e5004f4e9b87c0c322eab5d9/users/acc8572befc74a568342003686b4b1f2/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:09.691739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:09.695448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:09.798129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:09.799511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:09.800075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:09.800637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:09.837999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6add3c-d0c7-498f-bde8-d2c118ed436e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:09.843411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:09.844325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:09.844578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:09.844951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:09.931116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:09.933489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:09.946761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 877/1748] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:09 2021] GET /identity/v3/auth/tokens => generated 3343 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:09.947691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:10.023410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:10.027584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:10.057850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 872/1749] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:09 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:10.061143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:10.063898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:10.160674 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af0f64-4984-482d-b086-c655d25444e9 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:10.185484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:10.186253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:10.186539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:10.188130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:10.188130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:10.196060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:10.303046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113618be-5d47-4e07-81ec-0b8809dc9d2d service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:10.377608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 878/1750] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:09 2021] POST /identity/v3/projects => generated 357 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:10.383772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:10.477540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5d00a-3e49-4afe-9c0e-81a216c308d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:10.479838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5d00a-3e49-4afe-9c0e-81a216c308d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:10.482663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5d00a-3e49-4afe-9c0e-81a216c308d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:10.484096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5d00a-3e49-4afe-9c0e-81a216c308d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:10.522764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5d00a-3e49-4afe-9c0e-81a216c308d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:10.526566 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5d00a-3e49-4afe-9c0e-81a216c308d7 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:10.559589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 873/1751] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:10.562265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03edb3-8361-4e2d-ae8d-cc25b2d1ab2f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:10.562534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03edb3-8361-4e2d-ae8d-cc25b2d1ab2f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:10.562892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03edb3-8361-4e2d-ae8d-cc25b2d1ab2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:10.656349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416ea5-e476-4817-8666-5b57f95283a2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:10.666473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ed03edb3-8361-4e2d-ae8d-cc25b2d1ab2f None None] MFA Rules not processed for user `f15af8a0192c4ca38a91f23d339bde20`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:10.669464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ed03edb3-8361-4e2d-ae8d-cc25b2d1ab2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:10.670826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b945d4-ecec-4771-ba4c-448c6fc6c53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:10.671712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b945d4-ecec-4771-ba4c-448c6fc6c53c service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:10.672054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b945d4-ecec-4771-ba4c-448c6fc6c53c service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:10.672384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b945d4-ecec-4771-ba4c-448c6fc6c53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:10.690498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b945d4-ecec-4771-ba4c-448c6fc6c53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:10.692205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b945d4-ecec-4771-ba4c-448c6fc6c53c service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:10.733157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 879/1752] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:10 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:10.734774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0426-75c2-47fd-88bb-5848cc2f6a58 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:10.735066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0426-75c2-47fd-88bb-5848cc2f6a58 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:10.735328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fe0426-75c2-47fd-88bb-5848cc2f6a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:10.821610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d7fe0426-75c2-47fd-88bb-5848cc2f6a58 None None] MFA Rules not processed for user `a5f9454bb4b24ce0acffefe1a316da73`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:10.823637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d7fe0426-75c2-47fd-88bb-5848cc2f6a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:11.033570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 874/1753] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:10 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:11.040418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f74d-1484-491b-af92-fe2b89d55e2e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:11.048704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f74d-1484-491b-af92-fe2b89d55e2e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:11.052147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842f74d-1484-491b-af92-fe2b89d55e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:11.165076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2842f74d-1484-491b-af92-fe2b89d55e2e None None] MFA Rules not processed for user `acc8572befc74a568342003686b4b1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:11.169336 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2842f74d-1484-491b-af92-fe2b89d55e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:11.441029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 880/1754] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:10 2021] POST /identity/v3/auth/tokens => generated 3339 bytes in 707 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:11.442050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0426-75c2-47fd-88bb-5848cc2f6a58 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:11.487936 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 875/1755] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:11 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:11.489979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f74d-1484-491b-af92-fe2b89d55e2e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:11.771885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fe0426-75c2-47fd-88bb-5848cc2f6a58 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:11.802702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:11.803937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:11.804438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:11.804944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:11.820582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:11.832132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:11.842287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842f74d-1484-491b-af92-fe2b89d55e2e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:11.860238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:11.861440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:11.862029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:11.862852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:11.911651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 881/1756] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:11 2021] POST /identity/v3/users => generated 285 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:11.914209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:11.957900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e4dbb-6723-4bf4-91af-014d677aed8e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:11.978361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:11.979607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:11.980031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:11.980518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:11.982472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:11.986322 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:12.080389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 882/1757] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:11 2021] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:12.100751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:12.138362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:12.144166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:12.190358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 876/1758] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:11 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:12.194113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:12.254149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337898b0-33a4-4956-ad7a-13a5e5b7ae71 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:12.452214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2f965-c971-4655-8d40-65336e0bd3ad admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:12.493179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:12.497733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:12.498367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:12.498908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:12.499305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:12.499427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:12.499873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:12.500572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:12.501377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:12.504092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:12.509241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:12.509422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:12.566319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 877/1759] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:12 2021] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:12.567782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:12.582464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b42f5-bc9d-47a8-b577-69ae0f8a6cad admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:12.616163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:12.617235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 883/1760] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:12 2021] POST /identity/v3/projects => generated 365 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:12.618860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:12.621790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:12.622744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:12.623204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:12.624282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:12.646507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:12.764803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 878/1761] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:12 2021] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:12.766333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:12.844965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c462e-247d-4a69-a6b1-910c8ca5dc83 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:12.922017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76760e68-f7ce-4314-becc-12ce52bc5e58 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:12.947888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:12.949557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:12.950040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:12.951607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] PATH_INFO: `/v3/projects/684212b60e684e0d948ccfeef69495be/users/9952045910eb4497804cfba784fde954/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:13.056361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684212b60e684e0d948ccfeef69495be, user_id=9952045910eb4497804cfba784fde954, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:13.064128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:13.098522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 884/1762] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:12 2021] PUT /identity/v3/projects/684212b60e684e0d948ccfeef69495be/users/9952045910eb4497804cfba784fde954/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:13.104960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:13.108832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:13.110117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:13.110605 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:13.111096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:13.112655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:13.117077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:13.190177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 879/1763] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:12 2021] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:13.190177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:13.243440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b69b67-5c60-4acf-8d7e-11b8021f5267 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:13.382271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87684a-4fa6-4f40-a689-adc0e7f008e5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:13.401574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:13.402705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:13.403185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:13.403673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:13.404982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:13.414900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:13.458226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 885/1764] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:13 2021] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:13.463822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:13.502097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48356a2-0dfa-4e59-a0f7-e5dfe3dee39b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:13.523665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:13.525031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:13.525544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:13.527090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:13.531211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:13.537624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:13.538886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:13.539351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:13.539848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:13.541658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:13.546220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:13.555708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:13.600403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 886/1765] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:13 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:13.609580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:13.634074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 880/1766] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:13 2021] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:13.634074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:13.661741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70447392-92ed-4c9d-af99-e201dbe6d3a2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:13.676077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb14a-7dbb-4f47-962d-ef5f52f6904a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:13.683609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:13.684935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:13.685601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:13.686773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] PATH_INFO: `/v3/projects/6d29c616a2174f3497a98ecf14f427ad/users/2148202af8d74d978303b9ac48d4ec7d/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:13.698197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:13.704148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:13.705833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:13.706280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] PATH_INFO: `/v3/projects/abbe6b6a9e2f4939a853d1cc6a5827d8/users/cd45cee348924de2b060cde2b7e3ee81/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:13.750146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d29c616a2174f3497a98ecf14f427ad, user_id=2148202af8d74d978303b9ac48d4ec7d, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:13.760863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:13.785568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbe6b6a9e2f4939a853d1cc6a5827d8, user_id=cd45cee348924de2b060cde2b7e3ee81, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:13.801830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:13.827258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 887/1767] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:13 2021] PUT /identity/v3/projects/6d29c616a2174f3497a98ecf14f427ad/users/2148202af8d74d978303b9ac48d4ec7d/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:13.827258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:13.852177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 881/1768] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:13 2021] PUT /identity/v3/projects/abbe6b6a9e2f4939a853d1cc6a5827d8/users/cd45cee348924de2b060cde2b7e3ee81/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:13.855251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:14.100996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb9d6b-be1d-4f85-bf7c-c8b99df401f3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:14.124772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:14.126008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:14.126525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:14.127077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:14.128169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:14.130417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:14.188909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20274120-2ce0-4c1e-8d1e-194647131bf9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:14.198026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 882/1769] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:13 2021] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:14.210400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:14.220984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:14.222639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:14.223116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:14.223571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] PATH_INFO: `/v3/projects/684212b60e684e0d948ccfeef69495be/users/9952045910eb4497804cfba784fde954/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:14.232391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684212b60e684e0d948ccfeef69495be, user_id=9952045910eb4497804cfba784fde954, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:14.246642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:14.263147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d52fa-d0dc-46d1-9835-4a807ff9c216 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:14.305842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 888/1770] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:13 2021] PUT /identity/v3/projects/684212b60e684e0d948ccfeef69495be/users/9952045910eb4497804cfba784fde954/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:14.312045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:14.464553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e40c45-d994-4392-ba72-9f101be882df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:14.467043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e40c45-d994-4392-ba72-9f101be882df admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:14.467431 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e40c45-d994-4392-ba72-9f101be882df admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:14.467773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e40c45-d994-4392-ba72-9f101be882df admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:14.472308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e40c45-d994-4392-ba72-9f101be882df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:14.474594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e40c45-d994-4392-ba72-9f101be882df admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:14.508373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 883/1771] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:14 2021] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:14.512182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238552-fad7-4c39-b9a8-02efb05982a4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:14.512445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238552-fad7-4c39-b9a8-02efb05982a4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:14.512829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77238552-fad7-4c39-b9a8-02efb05982a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:14.583039 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-77238552-fad7-4c39-b9a8-02efb05982a4 None None] MFA Rules not processed for user `9952045910eb4497804cfba784fde954`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:14.584438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-77238552-fad7-4c39-b9a8-02efb05982a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:14.593866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31331512-7529-4896-95be-3d8a15408082 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:14.640397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:14.642814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:14.643298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:14.643756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] PATH_INFO: `/v3/projects/6d29c616a2174f3497a98ecf14f427ad/users/2148202af8d74d978303b9ac48d4ec7d/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:14.649666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d29c616a2174f3497a98ecf14f427ad, user_id=2148202af8d74d978303b9ac48d4ec7d, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:14.656063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:14.693321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 889/1772] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:14 2021] PUT /identity/v3/projects/6d29c616a2174f3497a98ecf14f427ad/users/2148202af8d74d978303b9ac48d4ec7d/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:14.707521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:14.900755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 884/1773] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:14 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:14.902181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd6a81-2141-4bba-82c9-9f6872fa9944 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:14.902489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd6a81-2141-4bba-82c9-9f6872fa9944 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:14.902748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd6a81-2141-4bba-82c9-9f6872fa9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:15.009109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-eefd6a81-2141-4bba-82c9-9f6872fa9944 None None] MFA Rules not processed for user `2148202af8d74d978303b9ac48d4ec7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:15.010821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019b5e3-64b4-45ae-af1c-c3bf2a2277e5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:15.010971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-eefd6a81-2141-4bba-82c9-9f6872fa9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:15.035444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:15.036935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:15.037516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:15.038017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] PATH_INFO: `/v3/projects/abbe6b6a9e2f4939a853d1cc6a5827d8/users/cd45cee348924de2b060cde2b7e3ee81/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:15.044996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbe6b6a9e2f4939a853d1cc6a5827d8, user_id=cd45cee348924de2b060cde2b7e3ee81, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:15.052404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:15.098996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 890/1774] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:14 2021] PUT /identity/v3/projects/abbe6b6a9e2f4939a853d1cc6a5827d8/users/cd45cee348924de2b060cde2b7e3ee81/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:15.100800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:15.116341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:15.266909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554de470-7191-4c01-b1ed-fa8bd6ef9cd6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:15.277178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:15.279502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:15.280004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:15.281110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:15.356693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 885/1775] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:14 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:15.361179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca882-8811-41b3-b32c-85c42247780d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:15.369486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca882-8811-41b3-b32c-85c42247780d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:15.370404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ca882-8811-41b3-b32c-85c42247780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:15.516120 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:15.520485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:15.534689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-700ca882-8811-41b3-b32c-85c42247780d None None] MFA Rules not processed for user `cd45cee348924de2b060cde2b7e3ee81`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:15.538101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-700ca882-8811-41b3-b32c-85c42247780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:15.577710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 891/1776] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:15 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:15.579115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:15.610439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22153755-5f3e-4ec4-93f2-0fe1b34b03e5 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:15.622142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:15.623736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:15.624183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:15.627093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:15.828214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 886/1777] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:15 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:15.829751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca882-8811-41b3-b32c-85c42247780d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:15.894253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ca882-8811-41b3-b32c-85c42247780d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:15.904977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae3697-ddc0-4bc2-b246-fdc9cb4cc892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:15.905785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3697-ddc0-4bc2-b246-fdc9cb4cc892 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:15.906123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3697-ddc0-4bc2-b246-fdc9cb4cc892 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:15.906407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3697-ddc0-4bc2-b246-fdc9cb4cc892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:15.932609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:15.942662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:16.010677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 892/1778] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:15 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:16.076484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae3697-ddc0-4bc2-b246-fdc9cb4cc892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:16.081873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae3697-ddc0-4bc2-b246-fdc9cb4cc892 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:16.112721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 887/1779] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:15 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:16.347811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:16.383281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b53d2-7f08-41c7-93cf-e4ea038b6bb6 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:16.420760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:16.421941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:16.423101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:16.423101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:16.471490 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:16.474220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:16.527958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 893/1780] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:16 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:16.553954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79e8b1-8abf-4ba2-96a0-5e15e3d131f4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:16.554572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79e8b1-8abf-4ba2-96a0-5e15e3d131f4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:16.554906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79e8b1-8abf-4ba2-96a0-5e15e3d131f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:16.685733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7e79e8b1-8abf-4ba2-96a0-5e15e3d131f4 None None] MFA Rules not processed for user `1f1edff84d4e4fc99dd8158012f3e77d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:16.688069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7e79e8b1-8abf-4ba2-96a0-5e15e3d131f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:16.937783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:16.966864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15382e-5197-47bf-979f-31e36f25dd48 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:16.968371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 888/1781] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:16 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:16.996369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f4beb-12a5-45d2-99a1-e69a59f7c62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:17.009684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f4beb-12a5-45d2-99a1-e69a59f7c62d service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:17.010369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f4beb-12a5-45d2-99a1-e69a59f7c62d service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:17.010853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f4beb-12a5-45d2-99a1-e69a59f7c62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:17.207475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2023425-e76f-4344-a9d2-80ba68210e25 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:17.208118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2023425-e76f-4344-a9d2-80ba68210e25 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:17.208618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2023425-e76f-4344-a9d2-80ba68210e25 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:17.211188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 889/1782] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:17:17 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:17:17.238098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f4beb-12a5-45d2-99a1-e69a59f7c62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:17.239978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1f4beb-12a5-45d2-99a1-e69a59f7c62d service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:17.255856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2023425-e76f-4344-a9d2-80ba68210e25 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:17.276160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 894/1783] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:16 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:17.308123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5eb5-d9a3-4cd6-b220-9bfbc4c9c3d2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:17.308727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5eb5-d9a3-4cd6-b220-9bfbc4c9c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:17.309300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d5eb5-d9a3-4cd6-b220-9bfbc4c9c3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:17.395060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d60d5eb5-d9a3-4cd6-b220-9bfbc4c9c3d2 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:17.399258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d60d5eb5-d9a3-4cd6-b220-9bfbc4c9c3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:17.489902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2023425-e76f-4344-a9d2-80ba68210e25 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:17.510463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:17.512293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:17.516350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:17.517806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] PATH_INFO: `/v3/users/75a39af0ff22404890821f02cac85e81` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:17.520963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a39af0ff22404890821f02cac85e81)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:17.528824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:17.604993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 895/1784] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:17:17 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:17.660519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a39af0ff22404890821f02cac85e81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:17.662189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a39af0ff22404890821f02cac85e81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:17.686951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a39af0ff22404890821f02cac85e81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:17.706798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a39af0ff22404890821f02cac85e81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:17.722681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a39af0ff22404890821f02cac85e81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:17.744116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5eb5-d9a3-4cd6-b220-9bfbc4c9c3d2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:17.770613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d5eb5-d9a3-4cd6-b220-9bfbc4c9c3d2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:17.781015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 890/1785] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:17 2021] DELETE /identity/v3/users/75a39af0ff22404890821f02cac85e81 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:17.966984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:17.967625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:17.967905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:17.968353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:17.970713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:17.972178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:17.974888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:18.111550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:18.113058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:18.124985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 896/1786] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:17 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:18.169696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd66da-1471-4741-939e-c2d829dbff24 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:18.177348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:18.178374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:18.178832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:18.179165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:18.181854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:18.191953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:18.194463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:18.203866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:18.205202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:18.221371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 891/1787] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:18.304281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5986e62-0b59-4277-9f68-e15ab3a1503a service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:18.310774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:18.312605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:18.313023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:18.313399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] PATH_INFO: `/v3/projects/97e68b408d034c0c8857be85e3ca59f5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:18.315061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e68b408d034c0c8857be85e3ca59f5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:18.318555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:18.386878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e68b408d034c0c8857be85e3ca59f5', 'request_id': 'req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.394189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e68b408d034c0c8857be85e3ca59f5', 'request_id': 'req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.400748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e68b408d034c0c8857be85e3ca59f5', 'request_id': 'req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.422600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] The token cache is being invalidate because project 97e68b408d034c0c8857be85e3ca59f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:18.423005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.424398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.426514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 897/1788] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:18 2021] DELETE /identity/v3/projects/97e68b408d034c0c8857be85e3ca59f5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:18.432276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:18.451314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e598fc2-3601-4a5a-b7c2-29b77a07db74 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:18.534703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:18.536805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:18.537278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:18.537742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] PATH_INFO: `/v3/users/a5f9454bb4b24ce0acffefe1a316da73` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:18.541101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f9454bb4b24ce0acffefe1a316da73)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:18.544663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:18.626718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f9454bb4b24ce0acffefe1a316da73'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.627424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f9454bb4b24ce0acffefe1a316da73'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.636066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f9454bb4b24ce0acffefe1a316da73'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.652361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f9454bb4b24ce0acffefe1a316da73'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.666408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-707489ae-b4a0-4303-8a8e-47743e3cfacd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f9454bb4b24ce0acffefe1a316da73'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:18.683633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 892/1789] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:18 2021] DELETE /identity/v3/users/a5f9454bb4b24ce0acffefe1a316da73 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:18.981707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:18.984126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:19.018304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc3af9a-fcd4-4f02-9d72-88682f4f161c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:19.127041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:19.128225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.128555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.129055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] PATH_INFO: `/v3/projects/cb501663d9634cfcbb8766c325f9229d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.130574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb501663d9634cfcbb8766c325f9229d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:19.132643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:19.209953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb501663d9634cfcbb8766c325f9229d', 'request_id': 'req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:19.218759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb501663d9634cfcbb8766c325f9229d', 'request_id': 'req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:19.239500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb501663d9634cfcbb8766c325f9229d', 'request_id': 'req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:19.258051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] The token cache is being invalidate because project cb501663d9634cfcbb8766c325f9229d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:19.258480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:19.259470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c415a400-0039-48b6-b36b-3fe3fd2b6a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:19.261280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 898/1790] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:18 2021] DELETE /identity/v3/projects/cb501663d9634cfcbb8766c325f9229d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:19.267733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab5557-1f53-4c1c-9a15-35baba7362df None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.268071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab5557-1f53-4c1c-9a15-35baba7362df None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.268341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab5557-1f53-4c1c-9a15-35baba7362df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.288944 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a1ab5557-1f53-4c1c-9a15-35baba7362df None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:19.290390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a1ab5557-1f53-4c1c-9a15-35baba7362df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:19.359499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 893/1791] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:19.368210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4a16-bf58-4d68-b4e9-19ff10150da1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.368510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4a16-bf58-4d68-b4e9-19ff10150da1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.368765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4a16-bf58-4d68-b4e9-19ff10150da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.389710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e1bf4a16-bf58-4d68-b4e9-19ff10150da1 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:19.390959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e1bf4a16-bf58-4d68-b4e9-19ff10150da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:19.399846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 899/1792] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:19.404673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab5557-1f53-4c1c-9a15-35baba7362df None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:19.415456 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab5557-1f53-4c1c-9a15-35baba7362df None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:19.421078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:19.421803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.422081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.422382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.423140 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:19.423457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:19.425283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:19.439128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 894/1793] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:19.443915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4a16-bf58-4d68-b4e9-19ff10150da1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:19.454588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf4a16-bf58-4d68-b4e9-19ff10150da1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:19.460021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:19.460716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.461003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.461287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.462050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:19.464069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:19.502963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 900/1794] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:19 2021] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:17:19.508942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:19.520455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3a5b7-c460-4e2d-830c-b99588b2161b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:19.589610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:19.590340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.590655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.591191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.592929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:19.594965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:19.622832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 895/1795] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:19 2021] POST /identity/v3/users => generated 294 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:19.627459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:19.638738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d75f5e-0ef2-4446-9c0b-557ba19d3792 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:19.643939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:19.644645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.644956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.645234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.646053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:19.647718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:19.660906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 901/1796] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:17:19.666459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:19.678728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9bb9e-3b2c-449f-99a4-5c52998b58b6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:19.685864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d81aea-8b55-4fff-b350-30f086fa716d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:19.687047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d81aea-8b55-4fff-b350-30f086fa716d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.687488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d81aea-8b55-4fff-b350-30f086fa716d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.687959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d81aea-8b55-4fff-b350-30f086fa716d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.689142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d81aea-8b55-4fff-b350-30f086fa716d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:19.691002 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d81aea-8b55-4fff-b350-30f086fa716d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:19.703836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 896/1797] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:19 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:19.710236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:19.726731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b1e82-ec13-455d-bebc-9adf57a166a9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:19.733235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:19.734276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.734567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.734969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] PATH_INFO: `/v3/projects/8d77db84830a45eeae6d850a55bbff65/users/b9b5510650af44fe97a9442f80aa2a88/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.763210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d77db84830a45eeae6d850a55bbff65, user_id=b9b5510650af44fe97a9442f80aa2a88, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:19.768528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:19.800260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 902/1798] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:19 2021] PUT /identity/v3/projects/8d77db84830a45eeae6d850a55bbff65/users/b9b5510650af44fe97a9442f80aa2a88/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:19.813071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b4ca-059b-4152-8dc2-1261a44e083f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:19.813340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b4ca-059b-4152-8dc2-1261a44e083f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:19.813661 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b4ca-059b-4152-8dc2-1261a44e083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:19.846402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3ef9b4ca-059b-4152-8dc2-1261a44e083f None None] MFA Rules not processed for user `b9b5510650af44fe97a9442f80aa2a88`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:19.849342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3ef9b4ca-059b-4152-8dc2-1261a44e083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:19.976418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 897/1799] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:19 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:19.980275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:20.071011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cc0b4-6ba7-4586-b934-222b3a4c6275 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:20.080889 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:20.082710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.083201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.084374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.086039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:20.089913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:20.153726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 903/1800] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:19 2021] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:17:20.158062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b4ca-059b-4152-8dc2-1261a44e083f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:20.178205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b4ca-059b-4152-8dc2-1261a44e083f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:20.279469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:20.280602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.281080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.281682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.282877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:20.286898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:20.324460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 898/1801] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:20 2021] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:20.331281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:20.351622 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30578eb-799e-4a72-8ccd-0fb2c53a3ff0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:20.359530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:20.360263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.360725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.360971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.362131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:20.363874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:20.379003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 904/1802] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:20 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:20.388361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:20.401622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a8e54-b64e-452c-826c-f0ab386c7ee3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:20.412428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:20.413741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.414430 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.414968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] PATH_INFO: `/v3/projects/2bae430a28b74b6dbffdcf822d14ffc5/users/39655cec971a473b82b69ed2d502f6d7/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.437020 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bae430a28b74b6dbffdcf822d14ffc5, user_id=39655cec971a473b82b69ed2d502f6d7, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:20.440005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:20.464458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:20.465577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 899/1803] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:20 2021] PUT /identity/v3/projects/2bae430a28b74b6dbffdcf822d14ffc5/users/39655cec971a473b82b69ed2d502f6d7/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:20.478218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57574d1a-6ccb-4707-ad09-eda3876edeaf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:20.590780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850725f-68b0-4dae-9ee2-07c5a5442a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:20.591635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850725f-68b0-4dae-9ee2-07c5a5442a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.592038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850725f-68b0-4dae-9ee2-07c5a5442a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.592443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850725f-68b0-4dae-9ee2-07c5a5442a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.593533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850725f-68b0-4dae-9ee2-07c5a5442a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:20.595474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850725f-68b0-4dae-9ee2-07c5a5442a20 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:20.615117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 905/1804] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:20 2021] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:20.620274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:20.632461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4d8c6-ef46-493b-ab64-21118f50af97 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:20.638493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:20.639525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.639906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.640274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] PATH_INFO: `/v3/projects/2bae430a28b74b6dbffdcf822d14ffc5/users/39655cec971a473b82b69ed2d502f6d7/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.642795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bae430a28b74b6dbffdcf822d14ffc5, user_id=39655cec971a473b82b69ed2d502f6d7, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:20.645815 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:20.661638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 900/1805] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:20 2021] PUT /identity/v3/projects/2bae430a28b74b6dbffdcf822d14ffc5/users/39655cec971a473b82b69ed2d502f6d7/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:20.673477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645cd94-db6b-4535-96d6-88c85ac6d3f5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.673903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645cd94-db6b-4535-96d6-88c85ac6d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.674289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645cd94-db6b-4535-96d6-88c85ac6d3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.711383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a645cd94-db6b-4535-96d6-88c85ac6d3f5 None None] MFA Rules not processed for user `39655cec971a473b82b69ed2d502f6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:20.712752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a645cd94-db6b-4535-96d6-88c85ac6d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:20.873028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 906/1806] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:20 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:20.886490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:20.889501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:20.965543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1ae72-19b7-4d03-999f-5b8335841412 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:20.973475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64a97-cf49-40c8-94df-67a27cf4b88c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:20.974366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64a97-cf49-40c8-94df-67a27cf4b88c service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:20.974787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64a97-cf49-40c8-94df-67a27cf4b88c service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:20.975274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64a97-cf49-40c8-94df-67a27cf4b88c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:20.988693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64a97-cf49-40c8-94df-67a27cf4b88c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:20.991700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64a97-cf49-40c8-94df-67a27cf4b88c service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:21.011111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 901/1807] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:20 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:17:21.173749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645cd94-db6b-4535-96d6-88c85ac6d3f5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:21.359213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645cd94-db6b-4535-96d6-88c85ac6d3f5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:21.368534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:21.370149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:21.370619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:21.371084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] PATH_INFO: `/v3/users/b9b5510650af44fe97a9442f80aa2a88` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:21.374010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9b5510650af44fe97a9442f80aa2a88)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:21.378150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:21.592167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9b5510650af44fe97a9442f80aa2a88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:21.596699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9b5510650af44fe97a9442f80aa2a88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:21.628766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9b5510650af44fe97a9442f80aa2a88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:21.668482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9b5510650af44fe97a9442f80aa2a88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:21.694105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9b5510650af44fe97a9442f80aa2a88'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:21.711878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 907/1808] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:21 2021] DELETE /identity/v3/users/b9b5510650af44fe97a9442f80aa2a88 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:21.717949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:21.718711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:21.719449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:21.792133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:21.799539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:21.970621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 902/1809] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:21.989101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:21.992856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:22.223115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0c026-b3cf-4b75-ad33-3847c9b20e0b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:22.230434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:22.231974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:22.232709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:22.233384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:22.262271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:22.267315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:22.290696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 908/1810] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:22.631644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:22.641006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:22.709533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4817f7-1ed4-411f-a755-aa8d289c1c39 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:22.719673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:22.721581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:22.723941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:22.724482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] PATH_INFO: `/v3/users/f15af8a0192c4ca38a91f23d339bde20` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:22.727199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15af8a0192c4ca38a91f23d339bde20)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:22.734483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:22.843692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15af8a0192c4ca38a91f23d339bde20'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:22.845367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15af8a0192c4ca38a91f23d339bde20'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:22.877195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:22.884397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:22.897480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15af8a0192c4ca38a91f23d339bde20'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:22.927488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e8e6c-7232-4060-9515-21272b1952df service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:22.949801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:22.950770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:22.951071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:22.951295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15af8a0192c4ca38a91f23d339bde20'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:22.951458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] PATH_INFO: `/v3/projects/8d77db84830a45eeae6d850a55bbff65` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:22.962490 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d77db84830a45eeae6d850a55bbff65)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:22.964754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:22.985284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-db29ca6b-a3c8-4a24-a137-ec8ea1d50ac7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15af8a0192c4ca38a91f23d339bde20'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.006619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 903/1811] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:22 2021] DELETE /identity/v3/users/f15af8a0192c4ca38a91f23d339bde20 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:23.016800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:23.017471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:23.019658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:23.096744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d77db84830a45eeae6d850a55bbff65', 'request_id': 'req-f9ab442d-9b74-4e4d-8190-dde59df9a4be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.107238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d77db84830a45eeae6d850a55bbff65', 'request_id': 'req-f9ab442d-9b74-4e4d-8190-dde59df9a4be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.113938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:23.115671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:23.118071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d77db84830a45eeae6d850a55bbff65', 'request_id': 'req-f9ab442d-9b74-4e4d-8190-dde59df9a4be'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.138919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] The token cache is being invalidate because project 8d77db84830a45eeae6d850a55bbff65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:23.139473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.140291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.143314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 909/1812] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:22 2021] DELETE /identity/v3/projects/8d77db84830a45eeae6d850a55bbff65 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:23.148166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:23.149906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:23.258778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 904/1813] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:23.309153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:23.312320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:23.408890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab442d-9b74-4e4d-8190-dde59df9a4be admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:23.427343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:23.428267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:23.429397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:23.429752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] PATH_INFO: `/v3/users/39655cec971a473b82b69ed2d502f6d7` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:23.432190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39655cec971a473b82b69ed2d502f6d7)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:23.434345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:23.471970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9633db8-bed8-495b-a094-c2355cbc1ead None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:23.487932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:23.488657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:23.489071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:23.489621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:23.523848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:23.525407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:23.569747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 905/1814] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:23.595358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39655cec971a473b82b69ed2d502f6d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.596899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39655cec971a473b82b69ed2d502f6d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.625733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39655cec971a473b82b69ed2d502f6d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.656310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39655cec971a473b82b69ed2d502f6d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.671698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c2e04298-d2bd-43b8-b448-29935fab53c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39655cec971a473b82b69ed2d502f6d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:23.685820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 910/1815] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:23 2021] DELETE /identity/v3/users/39655cec971a473b82b69ed2d502f6d7 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:25.050214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:25.053699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:25.090298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e070f98-c82a-4d9d-8608-1a5e211c2f6c service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:25.231589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:25.233129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:25.233762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:25.234196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] PATH_INFO: `/v3/users/2dd96ca165554c9ea98222f27a8fb8de` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:25.235787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dd96ca165554c9ea98222f27a8fb8de)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:25.238057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:25.316909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dd96ca165554c9ea98222f27a8fb8de'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:25.318029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dd96ca165554c9ea98222f27a8fb8de'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:25.331504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dd96ca165554c9ea98222f27a8fb8de'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:25.375310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dd96ca165554c9ea98222f27a8fb8de'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:25.390898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dd96ca165554c9ea98222f27a8fb8de'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:25.404412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 906/1816] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:25 2021] DELETE /identity/v3/users/2dd96ca165554c9ea98222f27a8fb8de => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:25.411439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:25.412769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:25.413088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:25.439593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:25.442214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:25.609079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 911/1817] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:25.630318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:25.632585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:25.703096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:25.707126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:25.746275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26001638-43b5-46ba-bd0f-d76d6dab170a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:25.760947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:25.762167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:25.762779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:25.763028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] PATH_INFO: `/v3/projects/ab22b9d09ed14f7e8b926f320a972894` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:25.766869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab22b9d09ed14f7e8b926f320a972894)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:25.769086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:25.780736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f43938-45f4-4ff1-a705-797615668c27 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:25.787363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:25.788528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:25.789048 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:25.789500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:25.804451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:25.810868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:25.836795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 907/1818] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:17:25.919757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab22b9d09ed14f7e8b926f320a972894', 'request_id': 'req-f52c887f-5590-471e-9144-84d8b32a2d4c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:25.939004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab22b9d09ed14f7e8b926f320a972894', 'request_id': 'req-f52c887f-5590-471e-9144-84d8b32a2d4c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:25.966733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab22b9d09ed14f7e8b926f320a972894', 'request_id': 'req-f52c887f-5590-471e-9144-84d8b32a2d4c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.023280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] The token cache is being invalidate because project ab22b9d09ed14f7e8b926f320a972894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:26.023863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.026487 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.040099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 912/1819] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:25 2021] DELETE /identity/v3/projects/ab22b9d09ed14f7e8b926f320a972894 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:26.046305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:26.075854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb9d9f-5065-4a71-91bd-7faeb5cbcb2d service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:26.193040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:26.194211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:26.194655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:26.195110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] PATH_INFO: `/v3/users/2148202af8d74d978303b9ac48d4ec7d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:26.197577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2148202af8d74d978303b9ac48d4ec7d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:26.201381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:26.302747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2148202af8d74d978303b9ac48d4ec7d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.306253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2148202af8d74d978303b9ac48d4ec7d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.322861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2148202af8d74d978303b9ac48d4ec7d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.354442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2148202af8d74d978303b9ac48d4ec7d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.358522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:26.363061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:26.374800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2148202af8d74d978303b9ac48d4ec7d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.393790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 908/1820] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:26 2021] DELETE /identity/v3/users/2148202af8d74d978303b9ac48d4ec7d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:26.424798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52c887f-5590-471e-9144-84d8b32a2d4c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:26.614141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:26.615850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:26.616354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:26.616851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] PATH_INFO: `/v3/projects/2bae430a28b74b6dbffdcf822d14ffc5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:26.620007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bae430a28b74b6dbffdcf822d14ffc5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:26.625194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:26.646349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:26.648347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:26.674265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b675610-03fa-4469-aa93-a871f35321a2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:26.682990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:26.684807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:26.685293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:26.685799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] PATH_INFO: `/v3/projects/c22a86d172c84517b5f8528001888380` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:26.688334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22a86d172c84517b5f8528001888380)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:26.692267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:26.789850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bae430a28b74b6dbffdcf822d14ffc5', 'request_id': 'req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.810211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bae430a28b74b6dbffdcf822d14ffc5', 'request_id': 'req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.814883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22a86d172c84517b5f8528001888380', 'request_id': 'req-110034d4-9609-4320-a978-83bf473b22db'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.838708 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bae430a28b74b6dbffdcf822d14ffc5', 'request_id': 'req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.844994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22a86d172c84517b5f8528001888380', 'request_id': 'req-110034d4-9609-4320-a978-83bf473b22db'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.855032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22a86d172c84517b5f8528001888380', 'request_id': 'req-110034d4-9609-4320-a978-83bf473b22db'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.880383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] The token cache is being invalidate because project 2bae430a28b74b6dbffdcf822d14ffc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:26.880870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.882077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a0f40130-aa5c-4475-9dc9-7d48c4792bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.897156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] The token cache is being invalidate because project c22a86d172c84517b5f8528001888380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:26.897407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 913/1821] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:26 2021] DELETE /identity/v3/projects/2bae430a28b74b6dbffdcf822d14ffc5 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:26.898913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.899884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:26.900122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:26.900368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:26.900848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:26.905565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 909/1822] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:26 2021] DELETE /identity/v3/projects/c22a86d172c84517b5f8528001888380 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:26.910581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:26.912135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:26.947743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:26.950046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:26.997797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110034d4-9609-4320-a978-83bf473b22db admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.004082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.005136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.005422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.006203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] PATH_INFO: `/v3/users/4fd3c571182e48959248caec995306a2` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.007319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd3c571182e48959248caec995306a2)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.010267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.102790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 914/1823] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:27.104213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.106351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:27.116332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd3c571182e48959248caec995306a2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.117505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd3c571182e48959248caec995306a2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.123270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b9190-8e61-44aa-9d1f-9a77257de696 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.128214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.129560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.129853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.130131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] PATH_INFO: `/v3/projects/6d29c616a2174f3497a98ecf14f427ad` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.131657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d29c616a2174f3497a98ecf14f427ad)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.133588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd3c571182e48959248caec995306a2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.133794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.161497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd3c571182e48959248caec995306a2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.180150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61da0a75-7226-43e9-a92f-c0150ea2d20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd3c571182e48959248caec995306a2'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.195080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 910/1824] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:26 2021] DELETE /identity/v3/users/4fd3c571182e48959248caec995306a2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:27.197781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c8f9-8cdb-4cd3-a747-a2a6bcafca40 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.198230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c8f9-8cdb-4cd3-a747-a2a6bcafca40 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.198749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7c8f9-8cdb-4cd3-a747-a2a6bcafca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.210940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d29c616a2174f3497a98ecf14f427ad', 'request_id': 'req-be4595c4-f408-47f5-9369-a7707850494f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.220062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d29c616a2174f3497a98ecf14f427ad', 'request_id': 'req-be4595c4-f408-47f5-9369-a7707850494f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.227090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d29c616a2174f3497a98ecf14f427ad', 'request_id': 'req-be4595c4-f408-47f5-9369-a7707850494f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.235307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-96d7c8f9-8cdb-4cd3-a747-a2a6bcafca40 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:27.237297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-96d7c8f9-8cdb-4cd3-a747-a2a6bcafca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:27.246822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] The token cache is being invalidate because project 6d29c616a2174f3497a98ecf14f427ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:27.247898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.250372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-be4595c4-f408-47f5-9369-a7707850494f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:27.254195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 915/1825] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:27 2021] DELETE /identity/v3/projects/6d29c616a2174f3497a98ecf14f427ad => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:27.260303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936ad7-6893-4663-ad27-3966f8ba1388 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.261369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936ad7-6893-4663-ad27-3966f8ba1388 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.261815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e936ad7-6893-4663-ad27-3966f8ba1388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.290444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0e936ad7-6893-4663-ad27-3966f8ba1388 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:27.292002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0e936ad7-6893-4663-ad27-3966f8ba1388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:27.334319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 911/1826] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:27.339160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7c8f9-8cdb-4cd3-a747-a2a6bcafca40 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.354304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7c8f9-8cdb-4cd3-a747-a2a6bcafca40 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.364608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.365193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.365657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.366144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.368492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:27.368925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.371852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.393363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 912/1827] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:17:27.405670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.418255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43be808-9061-491c-8a5b-6dc96da733f3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.431281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 916/1828] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:27.435399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e17005-c304-46f8-acf8-81c6db93fa40 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.437446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.437733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e17005-c304-46f8-acf8-81c6db93fa40 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.438254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e17005-c304-46f8-acf8-81c6db93fa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.439554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.440041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.440535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.443623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.448839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.483454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f2e17005-c304-46f8-acf8-81c6db93fa40 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:27.484773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f2e17005-c304-46f8-acf8-81c6db93fa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:27.497861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 917/1829] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:27.502091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e17005-c304-46f8-acf8-81c6db93fa40 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.511825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 913/1830] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:27 2021] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:27.517005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.519887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e17005-c304-46f8-acf8-81c6db93fa40 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.652016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c6659-99c5-4c2d-b3d6-df8efa993a54 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.658863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.660146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.660501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.660840 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.661693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.664460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.666424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.667659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.668500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.669190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.670823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:27.671540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.675523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.694609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 914/1831] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:27 2021] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:27.698892 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.702270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 918/1832] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:27.707528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.724237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab380a8c-3c07-4217-8166-557de885d8e3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.725345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b82e82-cd52-4feb-b14f-f11e0d6b3563 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.731126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.731561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.732051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.732282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.732427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.732653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.732803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.733217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.733369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.734885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.735137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.737705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.753800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 915/1833] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:27 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:17:27.759747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.773245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c76b2-d1df-4e6f-a2e7-1c96c74de496 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.782915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.784847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.785832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.786592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.787328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 919/1834] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:27 2021] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:17:27.788744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.791885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.792676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:27.819009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 916/1835] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:27 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:17:27.823020 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:27.829249 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:27.858544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e670093f-ac9f-443b-b785-6eb7aa635dbf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.959104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb3cf38-d5bf-414d-8698-d57c60d158a8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:27.972491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:27.973217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:27.973564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:27.973859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:27.974532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:27.981156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:28.027385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 920/1836] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:27 2021] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:28.028510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:28.050303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:28.053377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.054637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.056331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] PATH_INFO: `/v3/projects/64648c2b44cd4cb6a14f0a1313bb2343` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.061689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64648c2b44cd4cb6a14f0a1313bb2343)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:28.062078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443605aa-cab5-4d36-94be-86dd0d9d758f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:28.065889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:28.087883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:28.089656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.090177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.090578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] PATH_INFO: `/v3/projects/c7d9ccc5d4f7459baf9204fc94093f83/users/4b198099344a4470ab9407a669701f8e/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.151958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d9ccc5d4f7459baf9204fc94093f83, user_id=4b198099344a4470ab9407a669701f8e, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:28.162119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64648c2b44cd4cb6a14f0a1313bb2343', 'request_id': 'req-f38376e1-8f8e-47b8-b9b7-c79122541a70'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:28.164955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:28.177607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64648c2b44cd4cb6a14f0a1313bb2343', 'request_id': 'req-f38376e1-8f8e-47b8-b9b7-c79122541a70'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:28.188639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64648c2b44cd4cb6a14f0a1313bb2343', 'request_id': 'req-f38376e1-8f8e-47b8-b9b7-c79122541a70'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:28.208970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 921/1837] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:28 2021] PUT /identity/v3/projects/c7d9ccc5d4f7459baf9204fc94093f83/users/4b198099344a4470ab9407a669701f8e/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:28.210654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:28.221075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] The token cache is being invalidate because project 64648c2b44cd4cb6a14f0a1313bb2343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:28.221471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:28.229018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f38376e1-8f8e-47b8-b9b7-c79122541a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:28.232550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 917/1838] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:27 2021] DELETE /identity/v3/projects/64648c2b44cd4cb6a14f0a1313bb2343 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:28.238487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.238487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.238487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.355407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] MFA Rules not processed for user `4b198099344a4470ab9407a669701f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:28.357052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:28.424109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e57c3a-63c3-416f-a891-b2f91f6786e2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:28.438351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f11b7-0168-4d95-bc7b-661ac866776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:28.439035 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f11b7-0168-4d95-bc7b-661ac866776c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.439305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f11b7-0168-4d95-bc7b-661ac866776c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.439583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f11b7-0168-4d95-bc7b-661ac866776c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.440475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f11b7-0168-4d95-bc7b-661ac866776c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:28.442223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6f11b7-0168-4d95-bc7b-661ac866776c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:28.475859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 922/1839] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:28 2021] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:28.485928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 918/1840] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:28 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:28.486666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.486666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.486666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.490043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:28.493496 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:28.521147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03d2f01-fb41-4d73-a327-25ede690567c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:28.531333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9331e5-3728-4307-8ed3-cbd56bfcb841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:28.532109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:28.533151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9331e5-3728-4307-8ed3-cbd56bfcb841 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.533532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:28.534570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9331e5-3728-4307-8ed3-cbd56bfcb841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.535301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9331e5-3728-4307-8ed3-cbd56bfcb841 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.538006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9331e5-3728-4307-8ed3-cbd56bfcb841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:28.541975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9331e5-3728-4307-8ed3-cbd56bfcb841 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:28.567645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 923/1841] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:28.567645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:28.567645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:28.595355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 919/1842] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:28 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:28.596078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df878-2c17-410f-ba86-281b8ac49860 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:28.598750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0394454-d21a-4b2d-87e2-7cefa5578a51 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.599843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0394454-d21a-4b2d-87e2-7cefa5578a51 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.600591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0394454-d21a-4b2d-87e2-7cefa5578a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.615405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:28.616222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.616530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.616840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.617668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:28.620150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:28.642753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e0394454-d21a-4b2d-87e2-7cefa5578a51 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:28.645831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e0394454-d21a-4b2d-87e2-7cefa5578a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:28.682081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 924/1844] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:28 2021] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:28.684866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:28.690178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 920/1843] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:28.692985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0394454-d21a-4b2d-87e2-7cefa5578a51 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:28.751672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0394454-d21a-4b2d-87e2-7cefa5578a51 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:28.781914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13458-8fb7-4209-9027-2fe13740bb76 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:28.789218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:28.790291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:28.790614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:28.790922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] PATH_INFO: `/v3/projects/698675e30b59432a9b29a96945a9dc53/users/9c74e4bad2f84932a31b9a13c34fc9de/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:28.811831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698675e30b59432a9b29a96945a9dc53, user_id=9c74e4bad2f84932a31b9a13c34fc9de, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:28.815212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:28.833190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 925/1845] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:28 2021] PUT /identity/v3/projects/698675e30b59432a9b29a96945a9dc53/users/9c74e4bad2f84932a31b9a13c34fc9de/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:28.834482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.032607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcf09a-59b6-410e-a62f-2688adb03379 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.043108 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507bf79-c3c8-420a-b814-7ae14b7d92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.044428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507bf79-c3c8-420a-b814-7ae14b7d92ee admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.045008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507bf79-c3c8-420a-b814-7ae14b7d92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.045732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507bf79-c3c8-420a-b814-7ae14b7d92ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.048107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507bf79-c3c8-420a-b814-7ae14b7d92ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:29.048673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507bf79-c3c8-420a-b814-7ae14b7d92ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.053231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507bf79-c3c8-420a-b814-7ae14b7d92ee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.064006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.071528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.072576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.073068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.077641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.082995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 921/1846] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:29.086516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67f5aa-ce59-427c-916a-5982767e4470 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.087106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67f5aa-ce59-427c-916a-5982767e4470 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.088254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67f5aa-ce59-427c-916a-5982767e4470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.092418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.177632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 926/1847] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:28 2021] POST /identity/v3/users => generated 299 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:29.181012 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.182747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3c67f5aa-ce59-427c-916a-5982767e4470 None None] MFA Rules not processed for user `9c74e4bad2f84932a31b9a13c34fc9de`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:29.185158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3c67f5aa-ce59-427c-916a-5982767e4470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:29.214114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b712d-f0da-4fee-a0ac-a6819d770563 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.248836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.250272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.250820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.251372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.252712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.264398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.346031 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 927/1848] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:29 2021] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:29.347560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.396186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 922/1849] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:29 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:29.396186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67f5aa-ce59-427c-916a-5982767e4470 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.404936 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67f5aa-ce59-427c-916a-5982767e4470 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.499293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98aa4b-0a9f-4e41-a0fb-b13e79ca451f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.505095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.505993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.506851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.507301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.508136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.509764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.510137 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.513239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.514442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.515136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.516766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.521823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.529517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 928/1850] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:29 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:29.529517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.538354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275645e4-7c1e-4474-98b6-c54c17b28f18 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.543665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.544680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.545019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.545363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.546210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.548938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.585236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 923/1851] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:29 2021] POST /identity/v3/users => generated 289 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:29.585236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.607795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 929/1852] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:29 2021] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:29.610838 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.621125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a541ee-5146-4433-8ead-34a5d41a2cbf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.846303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.848016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.848546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.849056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] PATH_INFO: `/v3/projects/d256e96af89b4f9e922f30fc97183669/users/31fbd4ccf3694b5dbcd990848fc8852c/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.851526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a68f1-33d8-407d-b738-9fcb20c88dad admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.863996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:29.866472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:29.866930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:29.868653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:29.873092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.879958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.895491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d256e96af89b4f9e922f30fc97183669, user_id=31fbd4ccf3694b5dbcd990848fc8852c, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:29.901632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:29.906204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 930/1853] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:29 2021] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:29.907676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:29.941017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23663cab-2e22-4d75-9486-505047a8f81e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:29.943267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 924/1854] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:29 2021] PUT /identity/v3/projects/d256e96af89b4f9e922f30fc97183669/users/31fbd4ccf3694b5dbcd990848fc8852c/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:29.945065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.080390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6aeb1-b084-4d90-8789-a68fa07eddd6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.088653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.089949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.090407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.090883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.092492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.095854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.126234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 925/1855] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:29 2021] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:30.128047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.143602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ceb17-99db-4cc1-abfb-e02066893922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.147123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ceb17-99db-4cc1-abfb-e02066893922 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.147834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ceb17-99db-4cc1-abfb-e02066893922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.150704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ceb17-99db-4cc1-abfb-e02066893922 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.151184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170ab13-59b4-4753-8dbe-106279af5187 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.152604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ceb17-99db-4cc1-abfb-e02066893922 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.157286 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ceb17-99db-4cc1-abfb-e02066893922 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.160999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.162649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.163549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.163949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.165324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.168398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.196009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 926/1856] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:30 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:30.197022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.207095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 931/1857] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:29 2021] POST /identity/v3/users => generated 297 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:30.212038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064a86b-8318-4aeb-9b4a-5f2ee71b5873 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.212647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064a86b-8318-4aeb-9b4a-5f2ee71b5873 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.213303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064a86b-8318-4aeb-9b4a-5f2ee71b5873 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.215241 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add955de-f686-4879-bc13-8d88c5b9577c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.217382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 932/1858] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:17:30 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:17:30.218459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064a86b-8318-4aeb-9b4a-5f2ee71b5873 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.220817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.221811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.222091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.222362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] PATH_INFO: `/v3/projects/0d5c2939904e4024925b89000a37b91b/users/65d8e6ef649f4c72a1b7c84f4d3ee826/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.236212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064a86b-8318-4aeb-9b4a-5f2ee71b5873 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.240934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5c2939904e4024925b89000a37b91b, user_id=65d8e6ef649f4c72a1b7c84f4d3ee826, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.243523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c8b14-ce44-40b8-9b15-235394d754cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.244074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.245672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8b14-ce44-40b8-9b15-235394d754cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.246140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8b14-ce44-40b8-9b15-235394d754cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.246514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c8b14-ce44-40b8-9b15-235394d754cf admin admin] PATH_INFO: `/v3/projects/d256e96af89b4f9e922f30fc97183669/users/31fbd4ccf3694b5dbcd990848fc8852c/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.249923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c8b14-ce44-40b8-9b15-235394d754cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d256e96af89b4f9e922f30fc97183669, user_id=31fbd4ccf3694b5dbcd990848fc8852c, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.253052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c8b14-ce44-40b8-9b15-235394d754cf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.265690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 927/1859] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:30 2021] PUT /identity/v3/projects/0d5c2939904e4024925b89000a37b91b/users/65d8e6ef649f4c72a1b7c84f4d3ee826/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:30.266852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.268299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 933/1860] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:30 2021] PUT /identity/v3/projects/d256e96af89b4f9e922f30fc97183669/users/31fbd4ccf3694b5dbcd990848fc8852c/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:30.270464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1fe0-d74e-4ce0-be09-dbb55cbeef8c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.270781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1fe0-d74e-4ce0-be09-dbb55cbeef8c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.271064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1fe0-d74e-4ce0-be09-dbb55cbeef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.306733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-579b1fe0-d74e-4ce0-be09-dbb55cbeef8c None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:30.308183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-579b1fe0-d74e-4ce0-be09-dbb55cbeef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:30.368755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb7d80-f9d9-4263-ab12-369fc29d668f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.424070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 934/1861] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:17:30 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:30.425792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.426140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.426419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.475031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6e6b8-c9a2-408f-a26c-85a0f344ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.475963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e6b8-c9a2-408f-a26c-85a0f344ff64 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.476404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e6b8-c9a2-408f-a26c-85a0f344ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.476862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6e6b8-c9a2-408f-a26c-85a0f344ff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.477881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6e6b8-c9a2-408f-a26c-85a0f344ff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.480213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6e6b8-c9a2-408f-a26c-85a0f344ff64 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.497312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 928/1862] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:30 2021] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:30.499195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09d18-3cfb-4891-9180-b0b2e5242d1b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.499471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09d18-3cfb-4891-9180-b0b2e5242d1b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.499752 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09d18-3cfb-4891-9180-b0b2e5242d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.502751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] MFA Rules not processed for user `65d8e6ef649f4c72a1b7c84f4d3ee826`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:30.504042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:30.537199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d2a09d18-3cfb-4891-9180-b0b2e5242d1b None None] MFA Rules not processed for user `31fbd4ccf3694b5dbcd990848fc8852c`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:30.539490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d2a09d18-3cfb-4891-9180-b0b2e5242d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:30.617859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 935/1863] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:30 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:30.619714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.621503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:30.659415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0514a-847a-4609-904e-6fb970c8310f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.665693 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.666579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.666697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.666958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.679111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.681279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.702946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 936/1864] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:30.705699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.720960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 929/1865] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:30 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:30.722172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09d18-3cfb-4891-9180-b0b2e5242d1b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.730338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fab45-0744-4add-853e-3f9cb6b36ef1 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.739132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09d18-3cfb-4891-9180-b0b2e5242d1b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:30.745025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.745997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.746278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.746552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] PATH_INFO: `/v3/projects/bd6b65856d69424a8a6a20977f961902/users/56dc0bce3aae491d80375901469e946f/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.762056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:30.763795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:30.764082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:30.765283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:30.766141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.771787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.823009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6b65856d69424a8a6a20977f961902, user_id=56dc0bce3aae491d80375901469e946f, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:30.837130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:30.853374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 930/1866] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:30 2021] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:30.856675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 937/1867] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:30 2021] PUT /identity/v3/projects/bd6b65856d69424a8a6a20977f961902/users/56dc0bce3aae491d80375901469e946f/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:30.858095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.862193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:30.869871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:30.991583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67258ab9-078b-4ea7-89e2-d9257c82f0e0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:31.010250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:31.011757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.015336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.016178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.017122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:31.021873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:31.035093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3740865-1cb8-4329-8eba-5421ca51f85f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:31.112478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 938/1868] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:30 2021] POST /identity/v3/users => generated 290 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:31.116102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:31.177943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b9f4f-01a9-42f9-aedb-3452e35a27f5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:31.201383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:31.201717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:31.202774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.203223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.203700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.204712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.206174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.206699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.208169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:31.220816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:31.262318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 939/1869] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:31 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:31.263922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:31.314017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8de4-7a00-4ad6-a7d2-4d6cd6aea00f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:31.335196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:31.336343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.336987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.337288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.339271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:31.342481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:31.390380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 940/1870] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:31 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:31.395470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:31.435472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38436cab-bec3-477f-bba9-a8a4ae95d793 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:31.462475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:31.462696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16655-f85f-4335-8f49-9d49cb8f4b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:31.464609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16655-f85f-4335-8f49-9d49cb8f4b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.465042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16655-f85f-4335-8f49-9d49cb8f4b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.465168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:31.465634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16655-f85f-4335-8f49-9d49cb8f4b06 admin admin] PATH_INFO: `/v3/projects/bd6b65856d69424a8a6a20977f961902/users/56dc0bce3aae491d80375901469e946f/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.470311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d16655-f85f-4335-8f49-9d49cb8f4b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd6b65856d69424a8a6a20977f961902, user_id=56dc0bce3aae491d80375901469e946f, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:31.476988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d16655-f85f-4335-8f49-9d49cb8f4b06 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:31.497635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 931/1871] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:30 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:31.498668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 941/1872] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:31 2021] PUT /identity/v3/projects/bd6b65856d69424a8a6a20977f961902/users/56dc0bce3aae491d80375901469e946f/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:31.514320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:31.515722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.516443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.516443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.532678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af63d-eb70-4270-902c-50fa0192d7e2 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:31.608022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] MFA Rules not processed for user `56dc0bce3aae491d80375901469e946f`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:31.610094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:31.733221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:31.734306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.734768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.735126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.736364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:31.739866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:31.770798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 932/1873] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:31 2021] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:31.772659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:31.800015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d292d-ea58-4650-9cc5-9f02e545dd22 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:31.815352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507ec9f-824a-4dfa-96a8-fc6ce642f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:31.817221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507ec9f-824a-4dfa-96a8-fc6ce642f998 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.818846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507ec9f-824a-4dfa-96a8-fc6ce642f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.819237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507ec9f-824a-4dfa-96a8-fc6ce642f998 admin admin] PATH_INFO: `/v3/projects/554f82a3aab34d698a5b9005dc9512ec/users/8519a4c782c14d91a5a6bb644f99830f/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.822038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 942/1874] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:31 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:31.842893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:31.844878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:31.860555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507ec9f-824a-4dfa-96a8-fc6ce642f998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=554f82a3aab34d698a5b9005dc9512ec, user_id=8519a4c782c14d91a5a6bb644f99830f, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:31.865359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507ec9f-824a-4dfa-96a8-fc6ce642f998 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:31.903606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 933/1875] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:31 2021] PUT /identity/v3/projects/554f82a3aab34d698a5b9005dc9512ec/users/8519a4c782c14d91a5a6bb644f99830f/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:31.922113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e5f5-08b3-46fd-aa1a-dfffb45bdfec None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:31.922568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e5f5-08b3-46fd-aa1a-dfffb45bdfec None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:31.923035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149e5f5-08b3-46fd-aa1a-dfffb45bdfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:31.952782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442114d4-4e98-4919-99f8-41ff6607b63e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:32.011449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b149e5f5-08b3-46fd-aa1a-dfffb45bdfec None None] MFA Rules not processed for user `8519a4c782c14d91a5a6bb644f99830f`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:32.015476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b149e5f5-08b3-46fd-aa1a-dfffb45bdfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:32.037649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:32.038455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:32.038887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:32.040043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:32.210964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:32.213680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:32.225168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 934/1876] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:31 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:32.231267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e5f5-08b3-46fd-aa1a-dfffb45bdfec None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:32.251999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 943/1877] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:31 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:32.319394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149e5f5-08b3-46fd-aa1a-dfffb45bdfec None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:32.326307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:32.328003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:32.328003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:32.328003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:32.328676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:32.331876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:32.395726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:32.397302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 935/1878] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:32 2021] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:32.432998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167a819-318b-40cf-9dea-5084f77d19d2 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:32.680971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:32.686113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:32.686503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:32.686787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:32.687942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:32.695631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:32.751762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 944/1879] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:32 2021] POST /identity/v3/users => generated 295 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:17:32.757300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:32.802311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39686325-7939-480d-ab63-1ee59bdf3298 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:32.828831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:32.828831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:32.828831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:32.828831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:32.830385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:32.844992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:32.877593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 936/1880] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:32 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:32.884827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:32.916132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a967b9-6ed0-43da-a5c7-40dd34246b85 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:32.937260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f661a90-51ee-4a86-8b4f-41565b979f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:32.943325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661a90-51ee-4a86-8b4f-41565b979f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:32.944921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661a90-51ee-4a86-8b4f-41565b979f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:32.945755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661a90-51ee-4a86-8b4f-41565b979f60 admin admin] PATH_INFO: `/v3/projects/a20ed30400014cb39e92848809d65a2e/users/666d1165f8fd493ca363e0d92ebf37d7/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:32.999884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f661a90-51ee-4a86-8b4f-41565b979f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20ed30400014cb39e92848809d65a2e, user_id=666d1165f8fd493ca363e0d92ebf37d7, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:33.008488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f661a90-51ee-4a86-8b4f-41565b979f60 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:33.060199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 945/1881] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:32 2021] PUT /identity/v3/projects/a20ed30400014cb39e92848809d65a2e/users/666d1165f8fd493ca363e0d92ebf37d7/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:33.063793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:33.086620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d18474-1138-40f1-80fc-11d9ae1572ca admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:33.245991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dfebd-fff6-4f3a-814f-31f0bf496134 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.246462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dfebd-fff6-4f3a-814f-31f0bf496134 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.246985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dfebd-fff6-4f3a-814f-31f0bf496134 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.253358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 946/1882] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:17:33 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:17:33.271777 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2235be3-c4b2-4faa-807f-a132ae84c4f7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.272257 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2235be3-c4b2-4faa-807f-a132ae84c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.273702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2235be3-c4b2-4faa-807f-a132ae84c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.316408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:33.319948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.320427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.323084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.323336 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:33.329910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:33.349493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f2235be3-c4b2-4faa-807f-a132ae84c4f7 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:33.354186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f2235be3-c4b2-4faa-807f-a132ae84c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:33.357660 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 937/1883] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:33 2021] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:33.361592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:33.385083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab21503-0c9b-4d71-abd5-9a943d45776e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:33.400091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:33.401044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.401327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.401659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] PATH_INFO: `/v3/projects/a20ed30400014cb39e92848809d65a2e/users/666d1165f8fd493ca363e0d92ebf37d7/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.410193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20ed30400014cb39e92848809d65a2e, user_id=666d1165f8fd493ca363e0d92ebf37d7, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:33.414070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:33.439242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 938/1884] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:33 2021] PUT /identity/v3/projects/a20ed30400014cb39e92848809d65a2e/users/666d1165f8fd493ca363e0d92ebf37d7/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:33.440490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:33.548856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 947/1885] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:17:33 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:33.550445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902671c6-d81b-4ffb-b8ad-27bf8ee7b9c3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.550735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902671c6-d81b-4ffb-b8ad-27bf8ee7b9c3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.556553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902671c6-d81b-4ffb-b8ad-27bf8ee7b9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.588298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4ec44-3eaa-4a19-a661-5cd8cc7dc04a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:33.604604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc0bce3aae491d80375901469e946f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd6b65856d69424a8a6a20977f961902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:33.606161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.606678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.607120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.608074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:33.611613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:33.616542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:33.618291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-902671c6-d81b-4ffb-b8ad-27bf8ee7b9c3 None None] MFA Rules not processed for user `666d1165f8fd493ca363e0d92ebf37d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:33.619633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-902671c6-d81b-4ffb-b8ad-27bf8ee7b9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:33.659700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 939/1886] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:33.660741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:33.667690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:33.752654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 948/1887] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:33 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:33.754158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902671c6-d81b-4ffb-b8ad-27bf8ee7b9c3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:33.774916 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902671c6-d81b-4ffb-b8ad-27bf8ee7b9c3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:33.787055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc0bce3aae491d80375901469e946f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd6b65856d69424a8a6a20977f961902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:33.788144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.788448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.789277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.789599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:33.791847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:33.840015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 949/1888] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:33 2021] POST /identity/v3/projects => generated 353 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:33.842584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:33.846392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:33.847315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a8049-fdce-455f-a39a-855bb42d32b0 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:33.941525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e42c9-f4b5-4c0e-82a0-c5eebe8ee19b tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:33.952620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:33.954311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:33.954769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:33.955454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] PATH_INFO: `/v3/users/acc8572befc74a568342003686b4b1f2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:33.958662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc8572befc74a568342003686b4b1f2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:33.963415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:33.999519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:34.000602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.000882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.001152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.012867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:34.014679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:34.042640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 940/1889] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:34.043719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:34.089827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc8572befc74a568342003686b4b1f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.093037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc8572befc74a568342003686b4b1f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.110599 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc8572befc74a568342003686b4b1f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.126585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683d508-fcc0-4532-ab99-482cc82dd19d service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:34.141041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc8572befc74a568342003686b4b1f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.142691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:34.145833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.146342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.147541 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.157763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc8572befc74a568342003686b4b1f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.171601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 950/1890] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:33 2021] DELETE /identity/v3/users/acc8572befc74a568342003686b4b1f2 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:34.173856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:34.176397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:34.271854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:34.273359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:34.285157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 941/1891] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:34 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:34.286444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:34.374419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cb9aa-aa28-468c-81c2-2fd27b6f9433 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:34.394141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:34.401204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.401559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.401937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] PATH_INFO: `/v3/users/4b198099344a4470ab9407a669701f8e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.408840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b198099344a4470ab9407a669701f8e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:34.417377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:34.470321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3ab46-abba-4a68-9c9d-2635f0bd5218 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:34.543141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b198099344a4470ab9407a669701f8e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.544672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b198099344a4470ab9407a669701f8e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.565455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b198099344a4470ab9407a669701f8e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.571550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5add8eb-0536-4634-9fc8-63ef273c2b12 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc0bce3aae491d80375901469e946f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd6b65856d69424a8a6a20977f961902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:34.572551 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add8eb-0536-4634-9fc8-63ef273c2b12 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.572990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add8eb-0536-4634-9fc8-63ef273c2b12 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.573464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add8eb-0536-4634-9fc8-63ef273c2b12 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.574435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add8eb-0536-4634-9fc8-63ef273c2b12 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:34.574982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add8eb-0536-4634-9fc8-63ef273c2b12 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:34.583091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5add8eb-0536-4634-9fc8-63ef273c2b12 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:34.597625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b198099344a4470ab9407a669701f8e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.619938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b198099344a4470ab9407a669701f8e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:34.628114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 942/1892] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:34.629962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 951/1893] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:34 2021] DELETE /identity/v3/users/4b198099344a4470ab9407a669701f8e => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:34.631778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee05a1-a7d2-448e-bafa-fc58af2bdaa0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.633376 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:34.634665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee05a1-a7d2-448e-bafa-fc58af2bdaa0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.635523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee05a1-a7d2-448e-bafa-fc58af2bdaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.636792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:34.681358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b4ee05a1-a7d2-448e-bafa-fc58af2bdaa0 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:34.683414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b4ee05a1-a7d2-448e-bafa-fc58af2bdaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:34.745390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61403e-f78d-43a5-85c5-2be4ce67db4f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:34.761026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:34.762771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.763516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.764128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.772980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:34.805191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 943/1894] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:34.806558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.806845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.807124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.834966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:34.836349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:34.847691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 944/1895] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:34.852321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:34.854752 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:34.877567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:34.880173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:34.911673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 952/1896] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:34 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:34.917644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:34.923688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:34.950232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e394a6-a0ee-4583-aabf-bf220c315e1f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:34.955973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56dc0bce3aae491d80375901469e946f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd6b65856d69424a8a6a20977f961902', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:34.956874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:34.957156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:34.957466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] PATH_INFO: `/v3/projects/4c82cc2c11c34f14a442c7cd8c8a38f0` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:34.958759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4c82cc2c11c34f14a442c7cd8c8a38f0)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:34.960722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:35.020099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c88fc-75e6-4b8e-8d7d-9d4fb9d22ffe service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:35.034245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c82cc2c11c34f14a442c7cd8c8a38f0', 'request_id': 'req-280d47a5-ca7a-4830-9f40-a6a1606c0838'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.045466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c82cc2c11c34f14a442c7cd8c8a38f0', 'request_id': 'req-280d47a5-ca7a-4830-9f40-a6a1606c0838'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.057078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c82cc2c11c34f14a442c7cd8c8a38f0', 'request_id': 'req-280d47a5-ca7a-4830-9f40-a6a1606c0838'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.086457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] The token cache is being invalidate because project 4c82cc2c11c34f14a442c7cd8c8a38f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:35.086909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.088268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.092269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 945/1897] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:34 2021] DELETE /identity/v3/projects/4c82cc2c11c34f14a442c7cd8c8a38f0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:35.099068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:35.101268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:35.112241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:35.112941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:35.113227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:35.113537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:35.115795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:35.200062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:35.201775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:35.206497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d47a5-ca7a-4830-9f40-a6a1606c0838 tempest-VolumeQuotaClassesTest-1824189688 tempest-VolumeQuotaClassesTest-1824189688-project-admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:35.224392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8c775-638e-490d-8de5-361993e6039b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:35.225086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8c775-638e-490d-8de5-361993e6039b service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:35.225360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8c775-638e-490d-8de5-361993e6039b service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:35.225665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8c775-638e-490d-8de5-361993e6039b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:35.228260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 953/1898] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:35.228449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c5b8c775-638e-490d-8de5-361993e6039b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:35.251412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8c775-638e-490d-8de5-361993e6039b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:35.254441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8c775-638e-490d-8de5-361993e6039b service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:35.273507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 946/1899] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:35.544247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:35.545796 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:35.564397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4940e8-d514-4e17-92d5-ccf6945bb97a service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:35.572366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:35.573257 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:35.573637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:35.573924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] PATH_INFO: `/v3/users/9c74e4bad2f84932a31b9a13c34fc9de` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:35.575433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c74e4bad2f84932a31b9a13c34fc9de)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:35.577521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:35.650639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c74e4bad2f84932a31b9a13c34fc9de'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.651390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c74e4bad2f84932a31b9a13c34fc9de'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.660469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c74e4bad2f84932a31b9a13c34fc9de'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.690890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c74e4bad2f84932a31b9a13c34fc9de'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.701886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c74e4bad2f84932a31b9a13c34fc9de'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:35.722667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 954/1900] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:35 2021] DELETE /identity/v3/users/9c74e4bad2f84932a31b9a13c34fc9de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:35.725001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:35.726214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:35.726641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:35.758958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:35.761106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:35.844703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:35.846478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:35.941550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 947/1901] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:35.942394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:35.947621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:35.978514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6826ac-e64c-43c7-8d1a-21bc28228e2f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:35.988384 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:35.989630 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:35.989999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:35.990498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] PATH_INFO: `/v3/projects/c7d9ccc5d4f7459baf9204fc94093f83` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:35.993010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d9ccc5d4f7459baf9204fc94093f83)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:35.995176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:36.010339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62035d46-eaf5-4ef3-a20f-e65d64155807 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:36.042315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:36.043865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:36.044324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:36.050230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] PATH_INFO: `/v3/projects/12f98077e5004f4e9b87c0c322eab5d9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:36.052570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f98077e5004f4e9b87c0c322eab5d9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:36.056566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:36.110708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d9ccc5d4f7459baf9204fc94093f83', 'request_id': 'req-99d46566-f076-4e5a-9364-5569a6cc7940'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.128328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d9ccc5d4f7459baf9204fc94093f83', 'request_id': 'req-99d46566-f076-4e5a-9364-5569a6cc7940'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.142990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d9ccc5d4f7459baf9204fc94093f83', 'request_id': 'req-99d46566-f076-4e5a-9364-5569a6cc7940'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.175392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] The token cache is being invalidate because project c7d9ccc5d4f7459baf9204fc94093f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:36.176225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.176705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f98077e5004f4e9b87c0c322eab5d9', 'request_id': 'req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.178129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.185789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 948/1902] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:35 2021] DELETE /identity/v3/projects/c7d9ccc5d4f7459baf9204fc94093f83 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:36.188598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:36.188938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f98077e5004f4e9b87c0c322eab5d9', 'request_id': 'req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.191183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:36.197230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f98077e5004f4e9b87c0c322eab5d9', 'request_id': 'req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.219225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] The token cache is being invalidate because project 12f98077e5004f4e9b87c0c322eab5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:36.220663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.222042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.226382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 955/1903] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:35 2021] DELETE /identity/v3/projects/12f98077e5004f4e9b87c0c322eab5d9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:36.226382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:36.226779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:36.356704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d46566-f076-4e5a-9364-5569a6cc7940 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:36.376294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd4a65-d3bf-4ce5-8249-e069de1c77d2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:36.382955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:36.383896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:36.384168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:36.384411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] PATH_INFO: `/v3/users/31fbd4ccf3694b5dbcd990848fc8852c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:36.386756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fbd4ccf3694b5dbcd990848fc8852c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:36.390309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:36.478739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:36.479593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:36.480050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:36.480429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:36.483366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:36.499409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:36.501117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:36.512585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 949/1904] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:36.525938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:36.531460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:36.562684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825c845-733d-43f8-891b-16a5cf61bf5e service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:36.568210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fbd4ccf3694b5dbcd990848fc8852c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.572574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fbd4ccf3694b5dbcd990848fc8852c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.577464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:36.578465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:36.578744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:36.579018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] PATH_INFO: `/v3/users/cd45cee348924de2b060cde2b7e3ee81` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:36.585005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd45cee348924de2b060cde2b7e3ee81)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:36.588850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:36.630901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fbd4ccf3694b5dbcd990848fc8852c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.670922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fbd4ccf3694b5dbcd990848fc8852c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.694319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fbd4ccf3694b5dbcd990848fc8852c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.725186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd45cee348924de2b060cde2b7e3ee81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.726787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd45cee348924de2b060cde2b7e3ee81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.730478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 956/1905] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:36 2021] DELETE /identity/v3/users/31fbd4ccf3694b5dbcd990848fc8852c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:36.748427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd45cee348924de2b060cde2b7e3ee81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.775052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd45cee348924de2b060cde2b7e3ee81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.794468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-75a0e504-2bff-491e-90d4-537f95e6d5c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd45cee348924de2b060cde2b7e3ee81'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:36.815312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 950/1906] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:36 2021] DELETE /identity/v3/users/cd45cee348924de2b060cde2b7e3ee81 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:37.650453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:37.653724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:37.936915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38815a75-a421-4314-8478-5d712692a738 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:38.097675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:38.097675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.097675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.097675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] PATH_INFO: `/v3/projects/abbe6b6a9e2f4939a853d1cc6a5827d8` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.103848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbe6b6a9e2f4939a853d1cc6a5827d8)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:38.104464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:38.226602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbe6b6a9e2f4939a853d1cc6a5827d8', 'request_id': 'req-43740370-b82e-4717-9837-96bab4e538c2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.237699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbe6b6a9e2f4939a853d1cc6a5827d8', 'request_id': 'req-43740370-b82e-4717-9837-96bab4e538c2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.246940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbe6b6a9e2f4939a853d1cc6a5827d8', 'request_id': 'req-43740370-b82e-4717-9837-96bab4e538c2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.288984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] The token cache is being invalidate because project abbe6b6a9e2f4939a853d1cc6a5827d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:38.289354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.291722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.301037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 957/1907] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:37 2021] DELETE /identity/v3/projects/abbe6b6a9e2f4939a853d1cc6a5827d8 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:38.305977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.306692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.306841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.325405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:38.332217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:38.363086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:38.365474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:38.482627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43740370-b82e-4717-9837-96bab4e538c2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:38.518252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:38.521343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.521855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.522294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] PATH_INFO: `/v3/projects/698675e30b59432a9b29a96945a9dc53` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.529620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698675e30b59432a9b29a96945a9dc53)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:38.533811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:38.559646 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 951/1908] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:38.563317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:38.565176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:38.590307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a1b2-5154-4c1c-a898-a54e970e1735 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:38.601647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:38.604078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.604543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.604964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] PATH_INFO: `/v3/projects/d256e96af89b4f9e922f30fc97183669` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.612448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d256e96af89b4f9e922f30fc97183669)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:38.617200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:38.670441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698675e30b59432a9b29a96945a9dc53', 'request_id': 'req-12b84f59-2e03-4397-bd3e-a6793bb9af73'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.684349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698675e30b59432a9b29a96945a9dc53', 'request_id': 'req-12b84f59-2e03-4397-bd3e-a6793bb9af73'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.694624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698675e30b59432a9b29a96945a9dc53', 'request_id': 'req-12b84f59-2e03-4397-bd3e-a6793bb9af73'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.711150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd256e96af89b4f9e922f30fc97183669', 'request_id': 'req-1cc558cb-06bb-425d-9666-2b115a8d2c01'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.714649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] The token cache is being invalidate because project 698675e30b59432a9b29a96945a9dc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:38.715119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.716171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12b84f59-2e03-4397-bd3e-a6793bb9af73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.718490 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 958/1909] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:38 2021] DELETE /identity/v3/projects/698675e30b59432a9b29a96945a9dc53 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:38.720261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d248cb-44d2-4979-8b66-e9b262331a95 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.720607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d248cb-44d2-4979-8b66-e9b262331a95 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.721323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d248cb-44d2-4979-8b66-e9b262331a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.724230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd256e96af89b4f9e922f30fc97183669', 'request_id': 'req-1cc558cb-06bb-425d-9666-2b115a8d2c01'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.732328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd256e96af89b4f9e922f30fc97183669', 'request_id': 'req-1cc558cb-06bb-425d-9666-2b115a8d2c01'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.749334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d9d248cb-44d2-4979-8b66-e9b262331a95 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:38.750757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] The token cache is being invalidate because project d256e96af89b4f9e922f30fc97183669 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:38.750961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d9d248cb-44d2-4979-8b66-e9b262331a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:38.751520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.753622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.756123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 952/1910] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:38 2021] DELETE /identity/v3/projects/d256e96af89b4f9e922f30fc97183669 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:38.758861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:38.761731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:38.865546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 959/1911] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:38.868032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8202-4da8-42ff-b787-7e722521b94a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.868479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8202-4da8-42ff-b787-7e722521b94a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.868917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8202-4da8-42ff-b787-7e722521b94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.873872 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc558cb-06bb-425d-9666-2b115a8d2c01 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:38.882271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:38.883582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.884069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.884553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] PATH_INFO: `/v3/users/56dc0bce3aae491d80375901469e946f` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.886306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dc0bce3aae491d80375901469e946f)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:38.888635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:38.904858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f6ad8202-4da8-42ff-b787-7e722521b94a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:38.906188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f6ad8202-4da8-42ff-b787-7e722521b94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:38.926820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 960/1912] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:38.927723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8202-4da8-42ff-b787-7e722521b94a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:38.940408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8202-4da8-42ff-b787-7e722521b94a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:38.952817 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7911299-ffa4-408d-b8f6-1ac62875e0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:38.953763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7911299-ffa4-408d-b8f6-1ac62875e0db admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.954254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7911299-ffa4-408d-b8f6-1ac62875e0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.954705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7911299-ffa4-408d-b8f6-1ac62875e0db admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.955667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7911299-ffa4-408d-b8f6-1ac62875e0db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:38.956162 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7911299-ffa4-408d-b8f6-1ac62875e0db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:38.958535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7911299-ffa4-408d-b8f6-1ac62875e0db admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:38.988915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 961/1913] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:38.990618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7867b-d28e-4556-8c2c-1fa9edb4a90a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:38.991072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7867b-d28e-4556-8c2c-1fa9edb4a90a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:38.991213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7867b-d28e-4556-8c2c-1fa9edb4a90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:38.996597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dc0bce3aae491d80375901469e946f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:38.997838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dc0bce3aae491d80375901469e946f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.013880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1cd7867b-d28e-4556-8c2c-1fa9edb4a90a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:39.015718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1cd7867b-d28e-4556-8c2c-1fa9edb4a90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:39.032123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 962/1914] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:39.032123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7867b-d28e-4556-8c2c-1fa9edb4a90a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.032502 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dc0bce3aae491d80375901469e946f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.053746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7867b-d28e-4556-8c2c-1fa9edb4a90a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.060360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.061149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.061533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.061974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.062824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.064962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.116915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 963/1915] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:39 2021] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:39.119345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.143854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dc0bce3aae491d80375901469e946f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.179852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dc0bce3aae491d80375901469e946f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.205348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 953/1916] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:38 2021] DELETE /identity/v3/users/56dc0bce3aae491d80375901469e946f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:39.209312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.212613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:39.333578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6c5fd-a085-4537-93cc-deef3ee43059 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.418654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebac2c-e906-44e2-9835-fff2425fd34f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.428106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.429854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.430410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.431046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.432785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.437715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.463530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.464998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.465799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.466663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.469762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:39.470796 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.474320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.486078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 954/1917] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:39 2021] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:39.487962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.492226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:39.509904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 964/1918] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:39.509904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.517216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db77d8-98f6-448a-8920-4b2736eb62d4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.524795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c21738-8513-4f5f-b9bd-649c84260cc5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.525955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.528085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.528576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.529058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] PATH_INFO: `/v3/users/65d8e6ef649f4c72a1b7c84f4d3ee826` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.531805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d8e6ef649f4c72a1b7c84f4d3ee826)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.533331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.534816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.535279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.535815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.536539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.537201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.540369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.563300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 965/1919] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:39 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:39.564735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.568613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:39.594011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d0d0-e112-4e6f-b3b6-7f6b9f4c6788 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.606219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.607496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.608033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.608560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.609994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.614074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.630550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d8e6ef649f4c72a1b7c84f4d3ee826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.631281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d8e6ef649f4c72a1b7c84f4d3ee826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.639885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d8e6ef649f4c72a1b7c84f4d3ee826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.689959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 966/1920] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:39 2021] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:39.692689 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.694248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d8e6ef649f4c72a1b7c84f4d3ee826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.709637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d8e6ef649f4c72a1b7c84f4d3ee826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:39.750955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 955/1921] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:39 2021] DELETE /identity/v3/users/65d8e6ef649f4c72a1b7c84f4d3ee826 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:39.751309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:39.755447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:39.870595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518fb36a-bbea-4108-9556-2d32c450ebfe admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.881652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61862079-72b6-4e0f-8c66-f65e06bad853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.882937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61862079-72b6-4e0f-8c66-f65e06bad853 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.883523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61862079-72b6-4e0f-8c66-f65e06bad853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.884063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61862079-72b6-4e0f-8c66-f65e06bad853 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.885272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61862079-72b6-4e0f-8c66-f65e06bad853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.891560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61862079-72b6-4e0f-8c66-f65e06bad853 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.948161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aebe8e-6ce5-4f3d-8847-9d4b66d12cda admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:39.977513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 956/1922] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:39 2021] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:39.980112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:39.981644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.982046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.982422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:39.983342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:39.985268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:39.988152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:39.988702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:39.989200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.004615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 967/1923] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:39 2021] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:40.004615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.015169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b61ad-4985-4f26-a9c3-f61109e304a9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:40.021153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:40.022189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.022537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.023052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.023943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:40.025972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:40.039322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:40.042239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.045313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 968/1924] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:40 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:40.046565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.050956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.058953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 957/1925] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:40.065285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.065285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.090021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00702da1-73a4-40ef-8467-fdb16051ea3c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:40.096837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:40.097792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.098068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.098506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] PATH_INFO: `/v3/projects/bd6b65856d69424a8a6a20977f961902` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.100340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd6b65856d69424a8a6a20977f961902)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:40.104502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:40.109375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc86456-a710-4cf8-969a-e2025101641c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:40.125777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:40.127505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.128037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.128577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] PATH_INFO: `/v3/projects/7b7bfc4c34264b47b1c35c8c44eba0f2/users/666a62d2ed0d409898caee1b92e3401c/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.168076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7bfc4c34264b47b1c35c8c44eba0f2, user_id=666a62d2ed0d409898caee1b92e3401c, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:40.174156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:40.182000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd6b65856d69424a8a6a20977f961902', 'request_id': 'req-d283af04-2d56-46e6-a1f4-4ae10496d7ae'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.196070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd6b65856d69424a8a6a20977f961902', 'request_id': 'req-d283af04-2d56-46e6-a1f4-4ae10496d7ae'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.207766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 958/1926] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:40 2021] PUT /identity/v3/projects/7b7bfc4c34264b47b1c35c8c44eba0f2/users/666a62d2ed0d409898caee1b92e3401c/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:40.209577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd6b65856d69424a8a6a20977f961902', 'request_id': 'req-d283af04-2d56-46e6-a1f4-4ae10496d7ae'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.219293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.242728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] The token cache is being invalidate because project bd6b65856d69424a8a6a20977f961902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:40.243227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.244841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.248731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 969/1927] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:40 2021] DELETE /identity/v3/projects/bd6b65856d69424a8a6a20977f961902 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:40.250400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.254046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.363146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce8a15-0384-4bf2-b9a8-e4d593c8aa96 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:40.373015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e815c2-3603-483f-b3de-1ef74ccedf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:40.374376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e815c2-3603-483f-b3de-1ef74ccedf95 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.374825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e815c2-3603-483f-b3de-1ef74ccedf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.375256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e815c2-3603-483f-b3de-1ef74ccedf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.376616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e815c2-3603-483f-b3de-1ef74ccedf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:40.380477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e815c2-3603-483f-b3de-1ef74ccedf95 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:40.395978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283af04-2d56-46e6-a1f4-4ae10496d7ae admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:40.401966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 959/1928] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:40 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:40.405549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.406687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.407612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.463697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] MFA Rules not processed for user `666a62d2ed0d409898caee1b92e3401c`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:40.466954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.562996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b5d21-912f-4a9b-aa3d-6a1b8bbdb903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:40.564053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5d21-912f-4a9b-aa3d-6a1b8bbdb903 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.564578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5d21-912f-4a9b-aa3d-6a1b8bbdb903 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.564997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b5d21-912f-4a9b-aa3d-6a1b8bbdb903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.568964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4c8b5d21-912f-4a9b-aa3d-6a1b8bbdb903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.601058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b5d21-912f-4a9b-aa3d-6a1b8bbdb903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:40.603740 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8b5d21-912f-4a9b-aa3d-6a1b8bbdb903 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:40.642685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 970/1929] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:40.645711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242914-744f-422f-a029-9aea740c708b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.646296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242914-744f-422f-a029-9aea740c708b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.646845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242914-744f-422f-a029-9aea740c708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.686426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8c242914-744f-422f-a029-9aea740c708b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:40.689180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8c242914-744f-422f-a029-9aea740c708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.699991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 960/1930] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:40 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:40.701822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.712175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 971/1931] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:40.712175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242914-744f-422f-a029-9aea740c708b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.712175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8c242914-744f-422f-a029-9aea740c708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.712880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.732532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242914-744f-422f-a029-9aea740c708b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:40.741260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:40.743133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.743708 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.744226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] PATH_INFO: `/v3/users/e28dc2c404e344c192ff6a49f02f0b61` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.746835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28dc2c404e344c192ff6a49f02f0b61)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:40.750893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:40.766791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691cb66-9889-4ea8-9f19-a87b42666bb1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:40.774344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:40.794786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:40.794786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:40.795286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] PATH_INFO: `/v3/projects/b51de50158d04995a54933e00dd3cb41/users/3ee73967b95e47ad9e52533eafc9b941/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:40.829634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51de50158d04995a54933e00dd3cb41, user_id=3ee73967b95e47ad9e52533eafc9b941, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:40.834540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:40.871294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28dc2c404e344c192ff6a49f02f0b61'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.872513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28dc2c404e344c192ff6a49f02f0b61'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.877603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 961/1932] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:40 2021] PUT /identity/v3/projects/b51de50158d04995a54933e00dd3cb41/users/3ee73967b95e47ad9e52533eafc9b941/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:40.879159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:40.888239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:40.891449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28dc2c404e344c192ff6a49f02f0b61'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.941364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28dc2c404e344c192ff6a49f02f0b61'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:40.968356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4abc50ff-3116-422f-8a37-60936bfd27e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28dc2c404e344c192ff6a49f02f0b61'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:41.009422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 972/1933] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:40 2021] DELETE /identity/v3/users/e28dc2c404e344c192ff6a49f02f0b61 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:41.012139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b58af7-71a5-4a51-b90d-fa23e47c966a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.013929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b58af7-71a5-4a51-b90d-fa23e47c966a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.018953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b58af7-71a5-4a51-b90d-fa23e47c966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.128911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362c971-d650-4aca-ba22-853499596e3d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:41.134006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-41b58af7-71a5-4a51-b90d-fa23e47c966a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:41.161173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-41b58af7-71a5-4a51-b90d-fa23e47c966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:41.277118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c5c35c-f338-424d-be7b-6a3405986c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:41.278034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5c35c-f338-424d-be7b-6a3405986c64 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.278317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5c35c-f338-424d-be7b-6a3405986c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.278923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c5c35c-f338-424d-be7b-6a3405986c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.279758 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5c35c-f338-424d-be7b-6a3405986c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:41.282082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c5c35c-f338-424d-be7b-6a3405986c64 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:41.322830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 962/1934] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:40 2021] POST /identity/v3/projects => generated 385 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:41.326352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.326352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.326352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.399008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] MFA Rules not processed for user `3ee73967b95e47ad9e52533eafc9b941`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:41.408682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:41.420115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 973/1935] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:41.422752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378c5b-acfd-46d9-a9ef-d3bad742bab6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.423606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378c5b-acfd-46d9-a9ef-d3bad742bab6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.424133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b378c5b-acfd-46d9-a9ef-d3bad742bab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.456615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3b378c5b-acfd-46d9-a9ef-d3bad742bab6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:41.459528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3b378c5b-acfd-46d9-a9ef-d3bad742bab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:41.593473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 963/1936] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:41.595918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:41.598114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:41.618682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 974/1937] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:41.621857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378c5b-acfd-46d9-a9ef-d3bad742bab6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:41.673610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b378c5b-acfd-46d9-a9ef-d3bad742bab6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:41.689139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:41.690091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.690514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.690905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.691945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:41.692458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:41.695060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:41.714421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 975/1938] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:41.716044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:41.718976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:41.737613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01fb53-05fb-4188-b0b6-ddbf7d42d5df admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:41.743285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:41.744292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.744646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.744991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] PATH_INFO: `/v3/projects/0d5c2939904e4024925b89000a37b91b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.746485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5c2939904e4024925b89000a37b91b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:41.748622 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:41.754800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4bb8-d05c-4265-91a1-6897e86703e6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:41.763533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:41.764546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.765033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.765741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.766969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:41.770916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:41.808605 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 964/1939] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:41 2021] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:41.808605 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:41.809092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:41.830569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a79110-e9df-4365-8e50-e9f301a91de9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:41.830874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5c2939904e4024925b89000a37b91b', 'request_id': 'req-8ca23513-928e-4c73-bd2a-db506761b3a6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:41.904648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:41.906162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:41.906759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:41.907286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:41.908734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:41.913148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:41.959797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 965/1940] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:41 2021] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:41.960849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:41.965369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:41.968750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5c2939904e4024925b89000a37b91b', 'request_id': 'req-8ca23513-928e-4c73-bd2a-db506761b3a6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:41.975037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5c2939904e4024925b89000a37b91b', 'request_id': 'req-8ca23513-928e-4c73-bd2a-db506761b3a6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:41.991661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] The token cache is being invalidate because project 0d5c2939904e4024925b89000a37b91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:41.992179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:41.993317 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:41.995648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 976/1941] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:41 2021] DELETE /identity/v3/projects/0d5c2939904e4024925b89000a37b91b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:41.997055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:41.999769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.022842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23513-928e-4c73-bd2a-db506761b3a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.038586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fbf01-8591-43ce-a9b9-896c6112f079 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.042788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.043537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.043823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.044096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.046108 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.098033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.098636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.098921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.099195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.100006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.102052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.128982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.131935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.133958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 977/1942] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:41 2021] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:42.134827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.137422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.150788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 966/1943] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:42.152147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.154882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.175054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3cc47-db0c-4841-8237-9441eff7353b service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.297701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d6fcc-d2d0-4533-8c8a-c51c6e7128d5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.315182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.316841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.317233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.319156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.321035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.321407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.322024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.322931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.325471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.330618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.330618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.333357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.363754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 978/1944] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:42 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:42.363754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.366573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.384979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec689876-2cf6-4713-8f40-9ae3925dffb6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.398666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.398666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.398666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.398666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] PATH_INFO: `/v3/users/8519a4c782c14d91a5a6bb644f99830f` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.400653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8519a4c782c14d91a5a6bb644f99830f)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.401065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 967/1945] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:42 2021] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:42.402954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.406050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.424545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ada218-99bc-4cf2-965d-8cced695fe19 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.436879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.439052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.440266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.440985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.442721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.447116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.501514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 968/1946] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:42 2021] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:42.502586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.539212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40240a-2b41-426f-819b-0f144d61c62b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.545217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8519a4c782c14d91a5a6bb644f99830f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:42.546117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8519a4c782c14d91a5a6bb644f99830f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:42.551086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.553246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.553949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.554628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] PATH_INFO: `/v3/projects/e6fd61ec357749f49a60c76b44599da0/users/9ab5f735fcff4239ae4ec29cfad06db3/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.555045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8519a4c782c14d91a5a6bb644f99830f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:42.571861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8519a4c782c14d91a5a6bb644f99830f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:42.582083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8519a4c782c14d91a5a6bb644f99830f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:42.595645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 979/1947] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:42 2021] DELETE /identity/v3/users/8519a4c782c14d91a5a6bb644f99830f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:42.598500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.609955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.623258 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fd61ec357749f49a60c76b44599da0, user_id=9ab5f735fcff4239ae4ec29cfad06db3, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.629606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.665342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 969/1948] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:42 2021] PUT /identity/v3/projects/e6fd61ec357749f49a60c76b44599da0/users/9ab5f735fcff4239ae4ec29cfad06db3/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:42.667582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.676869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.825140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d770bf-c248-46a0-950f-c96ba3d34fcf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.903717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1141d-1155-4787-b36c-ab580c6c1829 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.921421 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.922515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.922860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.923141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.923962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.926112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.943599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 970/1949] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:42 2021] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:42.944633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:42.947769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:42.965784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1e8b8-0ac6-424f-8a30-03a26dbb08fc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:42.974531 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:42.975796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:42.976242 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:42.976803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:42.978219 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:42.980089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:42.996506 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 971/1950] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:42 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:42.998598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:43.003735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:43.004445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:43.008806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.011829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.014116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.016685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:43.020673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:43.052241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 980/1951] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:42 2021] GET /identity/v3/roles => generated 1420 bytes in 456 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:43.056218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:43.064257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e43a7a-c8cb-4359-a348-bdfac1c12bc4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:43.082611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:43.085601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.086771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.088307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] PATH_INFO: `/v3/projects/24d7bf61135a459f987182c30fb995ac` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.089397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820341d-b566-46c1-8d0b-9d3c26e6eaed admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:43.093793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d7bf61135a459f987182c30fb995ac)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:43.099255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:43.114696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:43.117592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.118038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.118518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.123044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:43.128546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:43.201550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 981/1952] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:43 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:43.204900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:43.211795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d7bf61135a459f987182c30fb995ac', 'request_id': 'req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.233395 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d7bf61135a459f987182c30fb995ac', 'request_id': 'req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.237509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53967f-ddca-41d0-a60b-c9e433be70f1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:43.258227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d7bf61135a459f987182c30fb995ac', 'request_id': 'req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.313265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] The token cache is being invalidate because project 24d7bf61135a459f987182c30fb995ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:43.316775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.321101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.331525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 972/1953] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:42 2021] DELETE /identity/v3/projects/24d7bf61135a459f987182c30fb995ac => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:43.333407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:43.336592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:43.369190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:43.370230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.370516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.371565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] PATH_INFO: `/v3/projects/e6fd61ec357749f49a60c76b44599da0/users/9ab5f735fcff4239ae4ec29cfad06db3/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.374712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fd61ec357749f49a60c76b44599da0, user_id=9ab5f735fcff4239ae4ec29cfad06db3, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:43.378746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:43.403736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 982/1954] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:43 2021] PUT /identity/v3/projects/e6fd61ec357749f49a60c76b44599da0/users/9ab5f735fcff4239ae4ec29cfad06db3/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:43.405775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:43.408640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:43.453017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8fc0e-bf9a-4dce-bc65-486a4e538678 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:43.519929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423b0d-0031-4912-8c7e-c01700f130f6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:43.525207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:43.526175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.526451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.526724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] PATH_INFO: `/v3/projects/d2568b7f18c247399110e4205b42da66/users/c96b4f73690e46799e1d7468554e3fcb/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.549264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2568b7f18c247399110e4205b42da66, user_id=c96b4f73690e46799e1d7468554e3fcb, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:43.552121 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:43.566693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371728e5-f9d3-454f-a038-97b3ce658b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:43.568571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371728e5-f9d3-454f-a038-97b3ce658b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.568894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371728e5-f9d3-454f-a038-97b3ce658b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.569172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371728e5-f9d3-454f-a038-97b3ce658b4a admin admin] PATH_INFO: `/v3/projects/9f088cb30d5c4cbb91754754ff2caae8/users/5d18ae1cc6514ba4a3f61d33a8e0ca95/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.571870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 983/1955] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:43 2021] PUT /identity/v3/projects/d2568b7f18c247399110e4205b42da66/users/c96b4f73690e46799e1d7468554e3fcb/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:43.572621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:43.575403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:43.598438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371728e5-f9d3-454f-a038-97b3ce658b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f088cb30d5c4cbb91754754ff2caae8, user_id=5d18ae1cc6514ba4a3f61d33a8e0ca95, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:43.607290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371728e5-f9d3-454f-a038-97b3ce658b4a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:43.650727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 973/1956] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:43 2021] PUT /identity/v3/projects/9f088cb30d5c4cbb91754754ff2caae8/users/5d18ae1cc6514ba4a3f61d33a8e0ca95/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:43.654185 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80058-88fe-4543-b1a9-3eec68e1c1b0 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.654578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80058-88fe-4543-b1a9-3eec68e1c1b0 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.655067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef80058-88fe-4543-b1a9-3eec68e1c1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.704311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2e40b-324e-4e04-8d43-314b10504263 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:43.709393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bef80058-88fe-4543-b1a9-3eec68e1c1b0 None None] MFA Rules not processed for user `9ab5f735fcff4239ae4ec29cfad06db3`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:43.711335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bef80058-88fe-4543-b1a9-3eec68e1c1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:43.849854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:43.850788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.852367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.852707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] PATH_INFO: `/v3/users/9952045910eb4497804cfba784fde954` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.854087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9952045910eb4497804cfba784fde954)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:43.857041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:43.883838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 974/1957] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:43 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:43.884979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:43.886052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:43.886238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:43.926543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9952045910eb4497804cfba784fde954'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.927556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9952045910eb4497804cfba784fde954'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.936805 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9952045910eb4497804cfba784fde954'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.938869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] MFA Rules not processed for user `c96b4f73690e46799e1d7468554e3fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:43.940368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:43.962102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9952045910eb4497804cfba784fde954'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.974906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9952045910eb4497804cfba784fde954'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:43.983452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 984/1958] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:43 2021] DELETE /identity/v3/users/9952045910eb4497804cfba784fde954 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:43.984744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:43.986306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.051274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 975/1959] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:43 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:44.053088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:44.055120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.078207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d1a51-6c90-44a7-9601-a6220df927b2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.126159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7738d0c-3236-4682-bfad-f031d13578c2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.136296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.139397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.140265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.140689 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.141891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.145317 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:44.171202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 985/1960] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:43 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:44.172654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:44.175800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.245112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.260366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.260595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.260817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] PATH_INFO: `/v3/projects/554f82a3aab34d698a5b9005dc9512ec` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.266647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=554f82a3aab34d698a5b9005dc9512ec)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.268865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:44.314282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f786-fb08-4844-b22f-59cb6c4130b5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.322777 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.324104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.324775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.325693 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.330048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.349610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '554f82a3aab34d698a5b9005dc9512ec', 'request_id': 'req-5311aad6-b06c-454b-a356-89acda905f79'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.357549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '554f82a3aab34d698a5b9005dc9512ec', 'request_id': 'req-5311aad6-b06c-454b-a356-89acda905f79'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.366415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '554f82a3aab34d698a5b9005dc9512ec', 'request_id': 'req-5311aad6-b06c-454b-a356-89acda905f79'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.385606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] The token cache is being invalidate because project 554f82a3aab34d698a5b9005dc9512ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:44.386057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.386756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.390792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 976/1961] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:44 2021] DELETE /identity/v3/projects/554f82a3aab34d698a5b9005dc9512ec => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:44.394947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:44.398375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.483141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.484635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:44.496682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 986/1962] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:44 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:44.497672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:44.511048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570c33f-2b4a-495e-af76-3a2916387d12 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.516663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.517627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.517903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.518180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] PATH_INFO: `/v3/projects/9f088cb30d5c4cbb91754754ff2caae8/users/5d18ae1cc6514ba4a3f61d33a8e0ca95/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.520358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f088cb30d5c4cbb91754754ff2caae8, user_id=5d18ae1cc6514ba4a3f61d33a8e0ca95, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.521004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311aad6-b06c-454b-a356-89acda905f79 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.523973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:44.530913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.532346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.533127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.534418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.536093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.540651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:44.553556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 987/1963] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:44 2021] PUT /identity/v3/projects/9f088cb30d5c4cbb91754754ff2caae8/users/5d18ae1cc6514ba4a3f61d33a8e0ca95/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:44.554667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:44.557078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.590203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 977/1964] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:44 2021] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:44.591798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:44.596694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.678868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20badaa3-36e7-422e-a4f8-0a0ac67400c4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.682331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c56e30-6bdb-467b-80ea-9a758b36f227 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.684886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.686049 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.686344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.686627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] PATH_INFO: `/v3/users/666a62d2ed0d409898caee1b92e3401c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.688548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666a62d2ed0d409898caee1b92e3401c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.690657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:44.691858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.693486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.694134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.694460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] PATH_INFO: `/v3/users/666d1165f8fd493ca363e0d92ebf37d7` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.697105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=666d1165f8fd493ca363e0d92ebf37d7)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.701504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:44.770885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666a62d2ed0d409898caee1b92e3401c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.772124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666a62d2ed0d409898caee1b92e3401c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.788856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666a62d2ed0d409898caee1b92e3401c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.813527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666d1165f8fd493ca363e0d92ebf37d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.813527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666d1165f8fd493ca363e0d92ebf37d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.817089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666a62d2ed0d409898caee1b92e3401c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.828269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666d1165f8fd493ca363e0d92ebf37d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.852389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0bc96fad-4a56-40e5-8b41-38a4be29ea11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666a62d2ed0d409898caee1b92e3401c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.853818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666d1165f8fd493ca363e0d92ebf37d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.864318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 978/1965] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:44 2021] DELETE /identity/v3/users/666a62d2ed0d409898caee1b92e3401c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:44.865914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666d1165f8fd493ca363e0d92ebf37d7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:44.866567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10203e24-d94f-45de-bf91-650bc2479ab7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.867391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10203e24-d94f-45de-bf91-650bc2479ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.867862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10203e24-d94f-45de-bf91-650bc2479ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.881473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 988/1966] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:44 2021] DELETE /identity/v3/users/666d1165f8fd493ca363e0d92ebf37d7 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:44.882589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:44.884141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.940859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-10203e24-d94f-45de-bf91-650bc2479ab7 None None] MFA Rules not processed for user `5d18ae1cc6514ba4a3f61d33a8e0ca95`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:44.943182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-10203e24-d94f-45de-bf91-650bc2479ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:44.992547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9593d7-8679-430a-aeb4-5875c378b5da admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:44.992547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:44.992547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:44.992547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:44.993271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:44.993271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:44.994038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.024748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 989/1967] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:44 2021] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:45.025449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.031134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.062864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3eb6b-e4a1-47de-992f-05b873eed8b1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.077556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.079653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.080289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.080917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] PATH_INFO: `/v3/projects/684212b60e684e0d948ccfeef69495be` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.084261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684212b60e684e0d948ccfeef69495be)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.091530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.100844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 979/1968] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:44 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:45.106571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718ecc-fb80-4317-846e-4b43223f1c51 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.108997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718ecc-fb80-4317-846e-4b43223f1c51 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.109386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7718ecc-fb80-4317-846e-4b43223f1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.137108 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d7718ecc-fb80-4317-846e-4b43223f1c51 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:45.139419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d7718ecc-fb80-4317-846e-4b43223f1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.162124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 980/1969] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:45.166709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718ecc-fb80-4317-846e-4b43223f1c51 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.191115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7718ecc-fb80-4317-846e-4b43223f1c51 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.215650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684212b60e684e0d948ccfeef69495be', 'request_id': 'req-3bac6445-2ff2-4047-a550-38411a3b4b10'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.227717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684212b60e684e0d948ccfeef69495be', 'request_id': 'req-3bac6445-2ff2-4047-a550-38411a3b4b10'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.241009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684212b60e684e0d948ccfeef69495be', 'request_id': 'req-3bac6445-2ff2-4047-a550-38411a3b4b10'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.258575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] The token cache is being invalidate because project 684212b60e684e0d948ccfeef69495be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:45.258848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.259621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.261587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 990/1970] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:45 2021] DELETE /identity/v3/projects/684212b60e684e0d948ccfeef69495be => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:45.270977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.270977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.310061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.311094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.311473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.312110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.312728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.315502 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.331930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 981/1971] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:45 2021] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:45.331930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.333220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.365571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac6445-2ff2-4047-a550-38411a3b4b10 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.370310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.370979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.372966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.372966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.374537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.429920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b37869-7158-47e1-a508-f296ff2a82b4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.436051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450e83e-ffff-47ff-8d9a-3bb083666499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.436615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e83e-ffff-47ff-8d9a-3bb083666499 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.436873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e83e-ffff-47ff-8d9a-3bb083666499 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.437147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450e83e-ffff-47ff-8d9a-3bb083666499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.439112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8450e83e-ffff-47ff-8d9a-3bb083666499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.453880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450e83e-ffff-47ff-8d9a-3bb083666499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.455278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450e83e-ffff-47ff-8d9a-3bb083666499 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.459340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.460835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.470516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 982/1972] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:45.471910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 991/1973] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:45 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:45.472809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.473350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.474116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.474231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.474855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.489648 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a92a33-3c7a-44b4-93a9-ff5b0f7864b4 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.499328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764de0ca-8566-4f29-ab9c-58da45ec2eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.500191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:45.500655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764de0ca-8566-4f29-ab9c-58da45ec2eac admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.501117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764de0ca-8566-4f29-ab9c-58da45ec2eac admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.501672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764de0ca-8566-4f29-ab9c-58da45ec2eac admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.502651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.503483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764de0ca-8566-4f29-ab9c-58da45ec2eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.508049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764de0ca-8566-4f29-ab9c-58da45ec2eac admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.513811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 983/1974] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:45.524663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.526000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 992/1975] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:45 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:45.526460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.527450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf3d7-2f18-4924-8eb8-a0228f25fa1a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.527829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf3d7-2f18-4924-8eb8-a0228f25fa1a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.528155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cf3d7-2f18-4924-8eb8-a0228f25fa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.555059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-382cf3d7-2f18-4924-8eb8-a0228f25fa1a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:45.556503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-382cf3d7-2f18-4924-8eb8-a0228f25fa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.568256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1827dbf-1168-42b6-8e57-d7c6079211f7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.575771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 993/1976] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:45.577642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf3d7-2f18-4924-8eb8-a0228f25fa1a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.587175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.588909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.589404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.589936 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] PATH_INFO: `/v3/projects/a20ed30400014cb39e92848809d65a2e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.593027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cf3d7-2f18-4924-8eb8-a0228f25fa1a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.595052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20ed30400014cb39e92848809d65a2e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.597356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.607592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.610359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.611713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.612580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] PATH_INFO: `/v3/projects/b3f2fbb77f944fd9ae1f99a69d2183b5/users/fa5ba2a8bd4940978322fa6edcb1650d/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.651790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f2fbb77f944fd9ae1f99a69d2183b5, user_id=fa5ba2a8bd4940978322fa6edcb1650d, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.651790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.689489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20ed30400014cb39e92848809d65a2e', 'request_id': 'req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.697570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20ed30400014cb39e92848809d65a2e', 'request_id': 'req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.701570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 994/1977] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:45 2021] PUT /identity/v3/projects/b3f2fbb77f944fd9ae1f99a69d2183b5/users/fa5ba2a8bd4940978322fa6edcb1650d/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:45.703827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.716325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20ed30400014cb39e92848809d65a2e', 'request_id': 'req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.763255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] The token cache is being invalidate because project a20ed30400014cb39e92848809d65a2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:45.764273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.767110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-83fb2739-f6be-48e0-ad9a-3ffae20efcb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:45.777392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 984/1978] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:45 2021] DELETE /identity/v3/projects/a20ed30400014cb39e92848809d65a2e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:45.781582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.782930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.783678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.829562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa50cd-1c47-49f5-851e-ab50f38d287f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.845608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] MFA Rules not processed for user `fa5ba2a8bd4940978322fa6edcb1650d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:45.847368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.850108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876c477-a252-41e2-876f-cd842e820b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.851728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c477-a252-41e2-876f-cd842e820b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.852227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c477-a252-41e2-876f-cd842e820b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.852713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876c477-a252-41e2-876f-cd842e820b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.854398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876c477-a252-41e2-876f-cd842e820b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:45.855026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876c477-a252-41e2-876f-cd842e820b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.857407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876c477-a252-41e2-876f-cd842e820b04 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.893711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 995/1979] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:45.896415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.897724 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.899317 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.924209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:45.925658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.935249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 996/1980] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:45.936461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.937995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:45.953624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47342b10-b84f-4e39-9aca-0fc59edc9943 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:45.959159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:45.960052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:45.960321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:45.960589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] PATH_INFO: `/v3/projects/7b7bfc4c34264b47b1c35c8c44eba0f2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:45.961919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7bfc4c34264b47b1c35c8c44eba0f2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:45.963827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:45.991803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 985/1981] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:45 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:45.995809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:45.999030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.027053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7bfc4c34264b47b1c35c8c44eba0f2', 'request_id': 'req-9b0b3714-13e3-4cf7-b583-45dc4847a871'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.032397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4d6a5-5ffd-433b-bcc3-d77e6f1e096e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.035595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7bfc4c34264b47b1c35c8c44eba0f2', 'request_id': 'req-9b0b3714-13e3-4cf7-b583-45dc4847a871'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.042540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7bfc4c34264b47b1c35c8c44eba0f2', 'request_id': 'req-9b0b3714-13e3-4cf7-b583-45dc4847a871'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.061725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] The token cache is being invalidate because project 7b7bfc4c34264b47b1c35c8c44eba0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:46.062273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.063111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9b0b3714-13e3-4cf7-b583-45dc4847a871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.065384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 997/1982] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:45 2021] DELETE /identity/v3/projects/7b7bfc4c34264b47b1c35c8c44eba0f2 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:46.067021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.067321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.068000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.092917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:46.094345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.133101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.133919 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.134255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.134599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.135432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.138023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.172685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 986/1983] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:45 2021] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:46.174564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.177343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.187895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 998/1984] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:46.187895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.189509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.210834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0b917-ed10-4efa-a1a6-b032e799dc4e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.287603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8275a-41e3-4431-b69d-154baeb9a607 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.292823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.293819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.294157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.294330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.294496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] PATH_INFO: `/v3/users/9ab5f735fcff4239ae4ec29cfad06db3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.295044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.295435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.295804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.296198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab5f735fcff4239ae4ec29cfad06db3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.296503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.298498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.298683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.342422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 987/1985] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:46 2021] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:46.342422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.342422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.374725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab5f735fcff4239ae4ec29cfad06db3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.375985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab5f735fcff4239ae4ec29cfad06db3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.389399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab5f735fcff4239ae4ec29cfad06db3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.419181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab5f735fcff4239ae4ec29cfad06db3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.432535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab5f735fcff4239ae4ec29cfad06db3'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.446074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 999/1986] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:46 2021] DELETE /identity/v3/users/9ab5f735fcff4239ae4ec29cfad06db3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:46.447804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.454621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.501476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859bc15-0264-4dac-a477-fb1f73e1ace7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.585532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.586462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.586750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.587577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] PATH_INFO: `/v3/users/3ee73967b95e47ad9e52533eafc9b941` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.588539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee73967b95e47ad9e52533eafc9b941)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.590770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.599779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35105f72-1aee-4c55-a705-bda04e15dfda admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.608289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.609543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.610035 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.610519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.611968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.616305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.653111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee73967b95e47ad9e52533eafc9b941'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.661337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1000/1987] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:46 2021] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:46.662450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.664839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.668439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee73967b95e47ad9e52533eafc9b941'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.683227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee73967b95e47ad9e52533eafc9b941'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.684700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ceb7b-d7fd-4e20-8506-795a6c92dddb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.691780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.692481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.692780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.693126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.693871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:46.694233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.696728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.701539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee73967b95e47ad9e52533eafc9b941'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.717022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1001/1988] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:46.717022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.718887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.719197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee73967b95e47ad9e52533eafc9b941'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:46.727927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 988/1989] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:46 2021] DELETE /identity/v3/users/3ee73967b95e47ad9e52533eafc9b941 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:46.728858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.730425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.735980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db316f7d-7605-4183-a407-61e0332a19d8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.829465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.829465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.829465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.829465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.830195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.831463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.856721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1002/1990] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:46 2021] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:46.857506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.859229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.867865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc3ffa-245a-4eee-a5c3-1aa369100772 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.873579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358a68e-a617-4775-be9b-001c3d793ccf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:46.877148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f05584-3706-41ad-b327-7d55b0415aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.877897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05584-3706-41ad-b327-7d55b0415aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.878234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05584-3706-41ad-b327-7d55b0415aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.878572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f05584-3706-41ad-b327-7d55b0415aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.879358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f05584-3706-41ad-b327-7d55b0415aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.881238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f05584-3706-41ad-b327-7d55b0415aa0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.882882 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:46.883710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.884047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.884311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.885100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:46.887332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:46.903359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 989/1991] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:46 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:46.906406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:46.907114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:46.907885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:46.920864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1003/1992] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:46 2021] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:46.925473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:46.927536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:46.937987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:46.939273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.007751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 990/1993] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:47.007961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0e384-2538-4f00-afcb-fa5f9fb6cdda admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.008690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.010101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.017419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.018679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.019408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.019851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.020705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.022573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.023651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e926de-de63-4945-bb2a-31829e0d1dd3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.029656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.030559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.030834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.031138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] PATH_INFO: `/v3/projects/e6fd61ec357749f49a60c76b44599da0` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.032494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fd61ec357749f49a60c76b44599da0)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.034608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1004/1994] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:46 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:47.035714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.037970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.046805 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ba7d70-21f1-4020-965e-d5fd44113fa3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.052495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.053185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.053499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.053778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.054535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.056164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.070071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1005/1995] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:47 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:47.071319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.084773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0526761-27bc-4406-a949-9c162325ce78 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.110377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fd61ec357749f49a60c76b44599da0', 'request_id': 'req-c5b54f2c-de9e-4747-894f-e15ce756d52a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:47.129868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fd61ec357749f49a60c76b44599da0', 'request_id': 'req-c5b54f2c-de9e-4747-894f-e15ce756d52a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:47.139692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fd61ec357749f49a60c76b44599da0', 'request_id': 'req-c5b54f2c-de9e-4747-894f-e15ce756d52a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:47.165710 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] The token cache is being invalidate because project e6fd61ec357749f49a60c76b44599da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:47.166284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.166471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:47.167387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:47.167700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.168406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.168975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.170530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.172014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 991/1996] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:47 2021] DELETE /identity/v3/projects/e6fd61ec357749f49a60c76b44599da0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:47.173675 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.175363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.179632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.211147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1006/1997] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:47 2021] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:47.211147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.213636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.234073 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5e068-829a-4428-ba87-c73d7e48d86a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.241365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf4adc-a62d-4657-9b12-7b4f9515999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.243056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf4adc-a62d-4657-9b12-7b4f9515999e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.243513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf4adc-a62d-4657-9b12-7b4f9515999e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.244028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf4adc-a62d-4657-9b12-7b4f9515999e admin admin] PATH_INFO: `/v3/projects/d5d76151f3014a71b93060f37db77e00/users/be8e8a482b404dcea681c0d958d81655/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.251148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b54f2c-de9e-4747-894f-e15ce756d52a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.258024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.259052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.259562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.260047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.263059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.270749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf4adc-a62d-4657-9b12-7b4f9515999e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d76151f3014a71b93060f37db77e00, user_id=be8e8a482b404dcea681c0d958d81655, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.276237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf4adc-a62d-4657-9b12-7b4f9515999e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.277013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.278723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.291026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 992/1998] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:47.294806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.296874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.300076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1007/1999] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:47 2021] PUT /identity/v3/projects/d5d76151f3014a71b93060f37db77e00/users/be8e8a482b404dcea681c0d958d81655/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:47.302525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4e8fe-0512-424b-a223-f8e7107cfa71 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.303033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4e8fe-0512-424b-a223-f8e7107cfa71 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.304290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4e8fe-0512-424b-a223-f8e7107cfa71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.313336 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66818fad-cf0a-427e-bd80-f3cf33bc847a service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.346567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7aa4e8fe-0512-424b-a223-f8e7107cfa71 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:47.348652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7aa4e8fe-0512-424b-a223-f8e7107cfa71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.403160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.404487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.404859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.405461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] PATH_INFO: `/v3/projects/dce0880e06e6461abce365056c197672/users/8fb53a1a687a4b8595c4bb1dbeda6059/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.430444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce0880e06e6461abce365056c197672, user_id=8fb53a1a687a4b8595c4bb1dbeda6059, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.435618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.471402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 993/2000] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:47 2021] PUT /identity/v3/projects/dce0880e06e6461abce365056c197672/users/8fb53a1a687a4b8595c4bb1dbeda6059/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:47.472896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.476646 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.492255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1008/2001] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:47.492255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4e8fe-0512-424b-a223-f8e7107cfa71 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.493946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4e8fe-0512-424b-a223-f8e7107cfa71 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.560469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67d945-5a21-4a4d-b317-a6bdb561144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.561166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d945-5a21-4a4d-b317-a6bdb561144a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.561458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d945-5a21-4a4d-b317-a6bdb561144a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.561747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67d945-5a21-4a4d-b317-a6bdb561144a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.562597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67d945-5a21-4a4d-b317-a6bdb561144a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.564371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f67d945-5a21-4a4d-b317-a6bdb561144a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.576846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1009/2002] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:47 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:47.579036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c21e4-ba69-4f34-8395-bdaca78f246a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.579294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c21e4-ba69-4f34-8395-bdaca78f246a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.579497 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c21e4-ba69-4f34-8395-bdaca78f246a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.624089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c8c2c-5007-4df9-9044-783c19809750 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.635909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c855ec4-6123-4b17-a452-403ff251940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.636257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855ec4-6123-4b17-a452-403ff251940b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.636408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855ec4-6123-4b17-a452-403ff251940b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.636679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c855ec4-6123-4b17-a452-403ff251940b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.637929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855ec4-6123-4b17-a452-403ff251940b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.640010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c855ec4-6123-4b17-a452-403ff251940b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.656330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f24c21e4-ba69-4f34-8395-bdaca78f246a None None] MFA Rules not processed for user `8fb53a1a687a4b8595c4bb1dbeda6059`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:47.658556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f24c21e4-ba69-4f34-8395-bdaca78f246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.676083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 994/2003] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:47 2021] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:47.676386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3456a0-2973-4868-9342-45b524e3cbb9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.676547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3456a0-2973-4868-9342-45b524e3cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.677060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3456a0-2973-4868-9342-45b524e3cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.724890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3a3456a0-2973-4868-9342-45b524e3cbb9 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:47.727643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3a3456a0-2973-4868-9342-45b524e3cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.745389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 995/2004] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:47.747424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3456a0-2973-4868-9342-45b524e3cbb9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.770442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1010/2005] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:47 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:47.771416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c21e4-ba69-4f34-8395-bdaca78f246a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.779279 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3456a0-2973-4868-9342-45b524e3cbb9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.784636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c21e4-ba69-4f34-8395-bdaca78f246a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.791685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.792571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.792864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.793174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.795590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.796538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.802995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.804613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.805095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.805605 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] PATH_INFO: `/v3/projects/d5d76151f3014a71b93060f37db77e00/users/be8e8a482b404dcea681c0d958d81655/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.809920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d76151f3014a71b93060f37db77e00, user_id=be8e8a482b404dcea681c0d958d81655, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.814728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1011/2006] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:47 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:47.816300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.817174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.823157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:47.829417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 996/2007] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:47 2021] PUT /identity/v3/projects/d5d76151f3014a71b93060f37db77e00/users/be8e8a482b404dcea681c0d958d81655/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:47.830477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.838571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ad1e0-1c23-4f60-87de-97719e61573e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.902787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.903694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.903974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.904424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] PATH_INFO: `/v3/projects/b51de50158d04995a54933e00dd3cb41` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.905910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51de50158d04995a54933e00dd3cb41)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.907876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.936508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb446d1-bd1c-4d68-b7ed-71183f790694 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.942613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:47.943332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:47.943810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:47.944234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:47.945012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:47.945324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:47.947032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:47.960522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 997/2008] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:47.961407 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:47.974220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557d6eb-5299-4073-b7dc-38e2cfdef0c5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:47.983293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51de50158d04995a54933e00dd3cb41', 'request_id': 'req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:47.994027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51de50158d04995a54933e00dd3cb41', 'request_id': 'req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.004581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51de50158d04995a54933e00dd3cb41', 'request_id': 'req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.022037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] The token cache is being invalidate because project b51de50158d04995a54933e00dd3cb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:48.022298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.023613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.025584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1012/2009] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:47 2021] DELETE /identity/v3/projects/b51de50158d04995a54933e00dd3cb41 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:48.026973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.030272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.074611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11ffc6-862a-4756-bf3c-fb3ba270bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.075740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ffc6-862a-4756-bf3c-fb3ba270bfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.076053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ffc6-862a-4756-bf3c-fb3ba270bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.076411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11ffc6-862a-4756-bf3c-fb3ba270bfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.077184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11ffc6-862a-4756-bf3c-fb3ba270bfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.079175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11ffc6-862a-4756-bf3c-fb3ba270bfb3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.111092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 998/2010] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:47 2021] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:48.113700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.114392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.114781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.129126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b580a6-b3ce-4563-b2ac-07d5951e3bed admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.148845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] MFA Rules not processed for user `be8e8a482b404dcea681c0d958d81655`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:48.151271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.208794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.209921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.210206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.210865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] PATH_INFO: `/v3/projects/57e49859784c40d9aefb271293dbec1c/users/66c27f209ec34b8591f6fbbe3540937c/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.231634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e49859784c40d9aefb271293dbec1c, user_id=66c27f209ec34b8591f6fbbe3540937c, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.235090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.251650 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 999/2011] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:48 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:48.253520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.255310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.267652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1013/2012] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:48 2021] PUT /identity/v3/projects/57e49859784c40d9aefb271293dbec1c/users/66c27f209ec34b8591f6fbbe3540937c/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:48.267652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.269271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.285689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ed795-f8f1-407e-b08e-843dd8aea41e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.343071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ee90-ef5c-4496-8989-b2d266db05c1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.349274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.350220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.350504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.350789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] PATH_INFO: `/v3/users/5d18ae1cc6514ba4a3f61d33a8e0ca95` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.351488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.352074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d18ae1cc6514ba4a3f61d33a8e0ca95)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.352262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.352741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.353134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.354044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.354172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.357577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.390582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1000/2013] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:48 2021] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:48.391925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.394524 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.413732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d18ae1cc6514ba4a3f61d33a8e0ca95'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.414726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d18ae1cc6514ba4a3f61d33a8e0ca95'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.427925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d18ae1cc6514ba4a3f61d33a8e0ca95'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.442789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d18ae1cc6514ba4a3f61d33a8e0ca95'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.451747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d18ae1cc6514ba4a3f61d33a8e0ca95'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:48.458885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1014/2014] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:48 2021] DELETE /identity/v3/users/5d18ae1cc6514ba4a3f61d33a8e0ca95 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:48.463459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.463459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.483265 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a5f7e-7f3a-4a45-9d2e-9c6cfecb2ae2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.553182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978cde9-27e7-48bf-9b7c-f0c904ec3ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.553804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cde9-27e7-48bf-9b7c-f0c904ec3ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.554086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cde9-27e7-48bf-9b7c-f0c904ec3ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.554353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978cde9-27e7-48bf-9b7c-f0c904ec3ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.555586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978cde9-27e7-48bf-9b7c-f0c904ec3ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.555750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa3c32-be26-4072-a8e0-89934f79c193 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.557196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978cde9-27e7-48bf-9b7c-f0c904ec3ee0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.562385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.563466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.563766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.564037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.566295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.587617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1001/2015] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:48 2021] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:48.587617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.587617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.587617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.615131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] MFA Rules not processed for user `66c27f209ec34b8591f6fbbe3540937c`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:48.616585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.660422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.662386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.675024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1015/2016] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:48 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:48.676014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.677537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.694899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d67e1e-6f31-424b-8a3c-d11568182f83 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.703172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1002/2017] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:48 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:48.703172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.704671 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.705291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.705636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.706044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.706445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.707374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.709803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.723077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dc334-6fac-40b5-af18-396ae2347d47 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.729956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.732727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.732727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.732727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.732727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.734442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.750349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1016/2018] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:48 2021] POST /identity/v3/users => generated 295 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:48.751510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.755495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:48.756691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1003/2019] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:48 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:48.758360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.773643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae4580-76ab-4cca-b44b-d2e2b28cd110 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.775809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fc465-0457-4400-ab1d-394dd8f3dd3a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.783710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.784813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.784974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.785879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.786035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.786304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.786535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.787094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.787232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.793000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.793531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.793621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:48.814432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1004/2020] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:48 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:48.815749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.834795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6887b2-4aab-4a66-9a70-4ba1be7bbe0b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.839456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1017/2021] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:48 2021] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:48.839456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:48.979618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0037e2-256d-4019-a7c7-7900408d215d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:48.988408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:48.989658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:48.990296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:48.990919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:48.992544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:48.996023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.020781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1018/2022] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:48 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:49.020781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.031241 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.032475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.032909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.033370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] PATH_INFO: `/v3/projects/84d4053b7b29491fa527cf0d71c70797/users/3222758f02ed4bbfb7dd0eb1d9986816/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.040150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c56a18-c097-4185-87c8-a440e6ea74ed admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.055335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.056709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.057184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.057520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.058329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.061283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d4053b7b29491fa527cf0d71c70797, user_id=3222758f02ed4bbfb7dd0eb1d9986816, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.062633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.066263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.091022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1005/2023] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:48 2021] PUT /identity/v3/projects/84d4053b7b29491fa527cf0d71c70797/users/3222758f02ed4bbfb7dd0eb1d9986816/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:49.092387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.094986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.112696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1019/2024] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:49 2021] POST /identity/v3/users => generated 298 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:49.112696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.129706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287ee1-7c59-4b2d-a381-5d7f72216427 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.238345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.240354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.240945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.241523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] PATH_INFO: `/v3/projects/0a33eb03acc74574be12592a7e460f8d/users/6726b7e07d3547428c598b6be18bb63c/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.274409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a33eb03acc74574be12592a7e460f8d, user_id=6726b7e07d3547428c598b6be18bb63c, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.278192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.300522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1020/2025] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:49 2021] PUT /identity/v3/projects/0a33eb03acc74574be12592a7e460f8d/users/6726b7e07d3547428c598b6be18bb63c/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:49.302027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.336518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d8f0-e6cf-46c0-8047-ee58c2e67557 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.431801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caefdf-d508-4a22-af6e-684cd74fa750 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.436097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.437014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.437532 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.437944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.438112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.438999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.439155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.439296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.439592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] PATH_INFO: `/v3/projects/9f088cb30d5c4cbb91754754ff2caae8` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.440916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f088cb30d5c4cbb91754754ff2caae8)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.441688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.443249 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.453771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1021/2026] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:49 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:49.454779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.464925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd90e3-5c46-4960-bb7c-7e0978ae59b8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.470395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459dc26f-1230-4b1f-92c5-3d1a269b37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.471084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc26f-1230-4b1f-92c5-3d1a269b37bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.471361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc26f-1230-4b1f-92c5-3d1a269b37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.471634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459dc26f-1230-4b1f-92c5-3d1a269b37bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.472402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dc26f-1230-4b1f-92c5-3d1a269b37bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.474201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459dc26f-1230-4b1f-92c5-3d1a269b37bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.485938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1022/2027] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:49.487421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.487705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.487981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.508959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f088cb30d5c4cbb91754754ff2caae8', 'request_id': 'req-0f942295-27a5-4071-915f-f58483c4d567'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:49.516260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f088cb30d5c4cbb91754754ff2caae8', 'request_id': 'req-0f942295-27a5-4071-915f-f58483c4d567'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:49.520601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] MFA Rules not processed for user `6726b7e07d3547428c598b6be18bb63c`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:49.522314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.523304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f088cb30d5c4cbb91754754ff2caae8', 'request_id': 'req-0f942295-27a5-4071-915f-f58483c4d567'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:49.538707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] The token cache is being invalidate because project 9f088cb30d5c4cbb91754754ff2caae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:49.538981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:49.539648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:49.541269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1006/2028] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:49 2021] DELETE /identity/v3/projects/9f088cb30d5c4cbb91754754ff2caae8 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:49.542270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.543790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.622646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1023/2029] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:49 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:49.627120 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.628694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.653714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f942295-27a5-4071-915f-f58483c4d567 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.659252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94673b-9d3c-4a5b-b345-e3d43c9f6558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.660196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94673b-9d3c-4a5b-b345-e3d43c9f6558 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.660320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94673b-9d3c-4a5b-b345-e3d43c9f6558 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.660525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94673b-9d3c-4a5b-b345-e3d43c9f6558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.662755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4a94673b-9d3c-4a5b-b345-e3d43c9f6558 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.718105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442a533-8fd8-4aea-b09d-d6288f986b2d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.731865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.733562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.734112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.734594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] PATH_INFO: `/v3/projects/84d4053b7b29491fa527cf0d71c70797/users/3222758f02ed4bbfb7dd0eb1d9986816/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.738834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d4053b7b29491fa527cf0d71c70797, user_id=3222758f02ed4bbfb7dd0eb1d9986816, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.743624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.760268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1024/2030] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:49 2021] PUT /identity/v3/projects/84d4053b7b29491fa527cf0d71c70797/users/3222758f02ed4bbfb7dd0eb1d9986816/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:49.762322 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.775459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.777269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94673b-9d3c-4a5b-b345-e3d43c9f6558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.782047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94673b-9d3c-4a5b-b345-e3d43c9f6558 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.800846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1007/2031] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:49 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:49.803772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.821873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.822358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.881676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:49.884457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.899993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1008/2032] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:49.901609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:49.916805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:49.931857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945fc5c-a3ca-4dbf-a3fc-a0cb9e0b73aa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.942745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d626f-75eb-45dc-acbf-b8058412381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.945175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d626f-75eb-45dc-acbf-b8058412381e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.945999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d626f-75eb-45dc-acbf-b8058412381e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.946687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd3eda-fb3e-4ce4-8488-8daa65cf00e3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:49.946863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d626f-75eb-45dc-acbf-b8058412381e admin admin] PATH_INFO: `/v3/projects/39e4bc64d2e3484d964d9e2eaf402e04/users/d069041849184ed5a4989764825ff857/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.955460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d696e-b7b8-4319-81c5-b91486d52f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:49.956582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d696e-b7b8-4319-81c5-b91486d52f3d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:49.957022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d696e-b7b8-4319-81c5-b91486d52f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:49.957528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d696e-b7b8-4319-81c5-b91486d52f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:49.959700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d696e-b7b8-4319-81c5-b91486d52f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.962749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d696e-b7b8-4319-81c5-b91486d52f3d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:49.983480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d626f-75eb-45dc-acbf-b8058412381e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e4bc64d2e3484d964d9e2eaf402e04, user_id=d069041849184ed5a4989764825ff857, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:49.988558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d626f-75eb-45dc-acbf-b8058412381e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.015108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1025/2033] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:49 2021] PUT /identity/v3/projects/39e4bc64d2e3484d964d9e2eaf402e04/users/d069041849184ed5a4989764825ff857/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:50.016601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9f43-0153-4d7f-8a38-71baca783c50 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.017088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9f43-0153-4d7f-8a38-71baca783c50 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.017890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a9f43-0153-4d7f-8a38-71baca783c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.019433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1009/2034] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:49 2021] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:50.022018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51926a-4657-4474-81f4-a6b405d198de None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.022481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51926a-4657-4474-81f4-a6b405d198de None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.022977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51926a-4657-4474-81f4-a6b405d198de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.054704 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-be51926a-4657-4474-81f4-a6b405d198de None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:50.057146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-be51926a-4657-4474-81f4-a6b405d198de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:50.058206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-df3a9f43-0153-4d7f-8a38-71baca783c50 None None] MFA Rules not processed for user `3222758f02ed4bbfb7dd0eb1d9986816`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:50.060782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-df3a9f43-0153-4d7f-8a38-71baca783c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:50.189568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1026/2035] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:50 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:50.190687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9f43-0153-4d7f-8a38-71baca783c50 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.211369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1010/2036] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:50.211369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51926a-4657-4474-81f4-a6b405d198de None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.234348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51926a-4657-4474-81f4-a6b405d198de None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.246402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.247041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.247381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.247687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.248515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.250323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.278343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1011/2037] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:50.278343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.287088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d59b83-1c90-4a84-b65b-7949fefd1c85 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.301803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.301803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.301803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.301803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.302326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:50.302326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.302326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.310934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a9f43-0153-4d7f-8a38-71baca783c50 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.317940 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1012/2038] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:50.319160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.321460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.323128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.323902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.324597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.326216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.331264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.335980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc589bf3-c0ec-4fa0-bf2c-90d7f8eba4b1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.342645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.344097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.344470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.344821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] PATH_INFO: `/v3/projects/39e4bc64d2e3484d964d9e2eaf402e04/users/d069041849184ed5a4989764825ff857/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.348917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e4bc64d2e3484d964d9e2eaf402e04, user_id=d069041849184ed5a4989764825ff857, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.352354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.366834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1013/2039] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:50 2021] PUT /identity/v3/projects/39e4bc64d2e3484d964d9e2eaf402e04/users/d069041849184ed5a4989764825ff857/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:50.368188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.380356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1027/2040] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:50 2021] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:50.384858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.517800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3a7fa-4e86-4d7f-9ff1-7e889db325e7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.539128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7101aff-d842-4a19-91a7-2ae5449c9a19 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.557587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.558563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.559247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.559628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.560909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.566156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.623530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855e3c-427a-4343-bc5b-3c2ce6af483c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.624709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855e3c-427a-4343-bc5b-3c2ce6af483c service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.625097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855e3c-427a-4343-bc5b-3c2ce6af483c service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.625574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855e3c-427a-4343-bc5b-3c2ce6af483c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.631162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1014/2041] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:50 2021] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:50.632943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.713982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855e3c-427a-4343-bc5b-3c2ce6af483c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.716077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855e3c-427a-4343-bc5b-3c2ce6af483c service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.727307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1028/2042] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:50 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:50.728784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0f0b-8a85-4771-befe-e74a239dd6cd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.729072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0f0b-8a85-4771-befe-e74a239dd6cd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.729411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b0f0b-8a85-4771-befe-e74a239dd6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.745679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030d5d7-0a32-4eaf-bbdd-3579dd1dbdb1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.751793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.752670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.753056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.753473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.754344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.756371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.768618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-547b0f0b-8a85-4771-befe-e74a239dd6cd None None] MFA Rules not processed for user `d069041849184ed5a4989764825ff857`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:50.774599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1015/2043] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:50.774804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-547b0f0b-8a85-4771-befe-e74a239dd6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:50.774976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.799908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86424244-ffce-4ff3-bb89-c3532340e4af admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.814642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.817843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.818763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.819466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.821076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.826442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.878974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1016/2044] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:50 2021] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:50.881046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.913334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1029/2045] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:50 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:50.914385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0f0b-8a85-4771-befe-e74a239dd6cd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.927967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b0f0b-8a85-4771-befe-e74a239dd6cd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.928318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19569da8-4e9a-4218-8798-f02177d0602a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:50.937077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.938080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.938402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.938681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.939454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.941275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.941821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:50.943750 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:50.944313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:50.945235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] PATH_INFO: `/v3/projects/f2f8b5426e194502a0f68fb790778ed6/users/89e54599b5c24203938fa7791dcc846e/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:50.957163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1030/2046] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:50.963566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:50.978439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f8b5426e194502a0f68fb790778ed6, user_id=89e54599b5c24203938fa7791dcc846e, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:50.982051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:50.986349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b7705-1f84-44d8-bba6-72bd66794196 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:51.012092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:51.012092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.012092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.012092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.012818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:51.012818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:51.013313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1017/2047] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:50 2021] PUT /identity/v3/projects/f2f8b5426e194502a0f68fb790778ed6/users/89e54599b5c24203938fa7791dcc846e/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:51.014369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:51.022354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1031/2048] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:51.023221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:51.039199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389611b3-694e-4172-ba52-19e68c0d7e26 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:51.093357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd2d3a-3420-4666-b37d-b7d121fdab74 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:51.098130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:51.099119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.099619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.099996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.102955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:51.144444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:51.144874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.145188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.145671 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.146430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:51.148140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:51.163642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1032/2049] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:51 2021] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:51.164522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:51.184280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c409e-d977-4f96-a16f-0bf2685fc7ca admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:51.197117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c71895-571a-4a07-addf-6fb335c2de59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:51.197364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:51.199018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:51.199301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71895-571a-4a07-addf-6fb335c2de59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.200439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71895-571a-4a07-addf-6fb335c2de59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.200923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c71895-571a-4a07-addf-6fb335c2de59 admin admin] PATH_INFO: `/v3/projects/d164854003b64baab112e8939f293e9d/users/15858e29c23a42a9946add428b84cf86/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.216284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1018/2050] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:51 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:51.218156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:51.248481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c71895-571a-4a07-addf-6fb335c2de59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d164854003b64baab112e8939f293e9d, user_id=15858e29c23a42a9946add428b84cf86, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:51.255704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c71895-571a-4a07-addf-6fb335c2de59 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:51.256620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8cdad-1f94-4b66-9978-26e56eaf51d3 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:51.273845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a98aca-dd4c-49c8-b9f6-246c2c46fd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:51.275610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98aca-dd4c-49c8-b9f6-246c2c46fd55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.276240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98aca-dd4c-49c8-b9f6-246c2c46fd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.276871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a98aca-dd4c-49c8-b9f6-246c2c46fd55 admin admin] PATH_INFO: `/v3/projects/f2f8b5426e194502a0f68fb790778ed6/users/89e54599b5c24203938fa7791dcc846e/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.281166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a98aca-dd4c-49c8-b9f6-246c2c46fd55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f8b5426e194502a0f68fb790778ed6, user_id=89e54599b5c24203938fa7791dcc846e, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:51.286884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a98aca-dd4c-49c8-b9f6-246c2c46fd55 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:51.295735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1033/2051] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:51 2021] PUT /identity/v3/projects/d164854003b64baab112e8939f293e9d/users/15858e29c23a42a9946add428b84cf86/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:51.307196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1019/2052] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:51 2021] PUT /identity/v3/projects/f2f8b5426e194502a0f68fb790778ed6/users/89e54599b5c24203938fa7791dcc846e/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:51.309690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.309980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.310310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.326841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.327142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.327803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.362115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] MFA Rules not processed for user `15858e29c23a42a9946add428b84cf86`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:51.363560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:51.377729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] MFA Rules not processed for user `89e54599b5c24203938fa7791dcc846e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:51.380957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:51.516535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1034/2053] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:51 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:51.532893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:51.535837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:51.554184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1020/2054] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:51 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:51.593144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:51.595479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:51.672017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2a57-29a0-42bd-af5f-9f03ba4b87f2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:51.680384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:51.682003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.686007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.686993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.691124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506152b-34b2-4bba-82d9-0b70d2ecd0cd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:51.697201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390d29f-8944-4e80-a1f5-5e223028635a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:51.698323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390d29f-8944-4e80-a1f5-5e223028635a service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:51.698755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390d29f-8944-4e80-a1f5-5e223028635a service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:51.700163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390d29f-8944-4e80-a1f5-5e223028635a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:51.703982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:51.709994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:51.716068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390d29f-8944-4e80-a1f5-5e223028635a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:51.717924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0390d29f-8944-4e80-a1f5-5e223028635a service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:51.731408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1035/2055] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:51 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:17:51.744452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1021/2056] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:51 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:52.406990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:52.538278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0a1ba-f9ac-4bf2-ad08-851ada1ef569 service glance] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:52.548369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:52.549854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:52.550489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:52.551236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] PATH_INFO: `/v3/users/6726b7e07d3547428c598b6be18bb63c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:52.561211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6726b7e07d3547428c598b6be18bb63c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:52.561211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:52.630587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6726b7e07d3547428c598b6be18bb63c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:52.631301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6726b7e07d3547428c598b6be18bb63c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:52.648972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6726b7e07d3547428c598b6be18bb63c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:52.667740 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6726b7e07d3547428c598b6be18bb63c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:52.677221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6726b7e07d3547428c598b6be18bb63c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:52.684672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1036/2057] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:52 2021] DELETE /identity/v3/users/6726b7e07d3547428c598b6be18bb63c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:52.690542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253829ba-9264-4f60-83a7-439a63134485 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:52.691200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253829ba-9264-4f60-83a7-439a63134485 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:52.691509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253829ba-9264-4f60-83a7-439a63134485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:52.723127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-253829ba-9264-4f60-83a7-439a63134485 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:52.725090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-253829ba-9264-4f60-83a7-439a63134485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:52.834122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1022/2058] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:52.844446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:52.850564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:53.072993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a4b84-6c10-4729-af02-3b31936a51d8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:53.084398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:53.086749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:53.087375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:53.087665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:53.113857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:53.118518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:53.148114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1037/2059] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:53.805781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253829ba-9264-4f60-83a7-439a63134485 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:53.807124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-253829ba-9264-4f60-83a7-439a63134485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:53.843494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253829ba-9264-4f60-83a7-439a63134485 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:53.854665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:53.855724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:53.856145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:53.856492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] PATH_INFO: `/v3/projects/0a33eb03acc74574be12592a7e460f8d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:53.858172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a33eb03acc74574be12592a7e460f8d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:53.860165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:53.943979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a33eb03acc74574be12592a7e460f8d', 'request_id': 'req-6eb3bdde-da94-4283-996b-dacf3d5194ef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:53.955609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a33eb03acc74574be12592a7e460f8d', 'request_id': 'req-6eb3bdde-da94-4283-996b-dacf3d5194ef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:53.965693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a33eb03acc74574be12592a7e460f8d', 'request_id': 'req-6eb3bdde-da94-4283-996b-dacf3d5194ef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:53.983319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] The token cache is being invalidate because project 0a33eb03acc74574be12592a7e460f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:53.983912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:53.985922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:53.988818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1023/2060] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:53 2021] DELETE /identity/v3/projects/0a33eb03acc74574be12592a7e460f8d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:53.994245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:54.006486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ea8c2-7b04-492b-8658-988b45a79af8 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:54.124232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:54.125608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:54.126221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:54.126977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] PATH_INFO: `/v3/users/89e54599b5c24203938fa7791dcc846e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:54.130374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e54599b5c24203938fa7791dcc846e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:54.133749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:54.227743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e54599b5c24203938fa7791dcc846e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.228656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e54599b5c24203938fa7791dcc846e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.239767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e54599b5c24203938fa7791dcc846e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.256352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e54599b5c24203938fa7791dcc846e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.266852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-64454862-bf9a-49c6-852f-eef83b61708b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e54599b5c24203938fa7791dcc846e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.274893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1038/2061] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:53 2021] DELETE /identity/v3/users/89e54599b5c24203938fa7791dcc846e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:54.295651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:54.297974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:54.321937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3bdde-da94-4283-996b-dacf3d5194ef admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:54.513273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:54.514438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:54.514869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:54.515243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] PATH_INFO: `/v3/users/8fb53a1a687a4b8595c4bb1dbeda6059` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:54.516821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb53a1a687a4b8595c4bb1dbeda6059)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:54.520872 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:54.602800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb53a1a687a4b8595c4bb1dbeda6059'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.603740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb53a1a687a4b8595c4bb1dbeda6059'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.613591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb53a1a687a4b8595c4bb1dbeda6059'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.630484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb53a1a687a4b8595c4bb1dbeda6059'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.646365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb53a1a687a4b8595c4bb1dbeda6059'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:54.655467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1024/2062] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:54 2021] DELETE /identity/v3/users/8fb53a1a687a4b8595c4bb1dbeda6059 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:54.661697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:54.662512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:54.662998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:54.687112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:54.689024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:54.846643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1039/2063] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:54.886038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:54.886038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:55.075746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.078153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:55.082930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf5aa9-9712-46f0-96eb-c436ee8b4d2e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.102915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508e23c-9248-4875-87e3-47e7cad54bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.104024 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e23c-9248-4875-87e3-47e7cad54bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.104482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e23c-9248-4875-87e3-47e7cad54bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.105023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e23c-9248-4875-87e3-47e7cad54bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.106205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c637d5-efa2-4708-8b61-9878a369084c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.112782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.114004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.114462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.115101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] PATH_INFO: `/v3/projects/f2f8b5426e194502a0f68fb790778ed6` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.116737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f8b5426e194502a0f68fb790778ed6)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.120846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.124781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508e23c-9248-4875-87e3-47e7cad54bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.127903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508e23c-9248-4875-87e3-47e7cad54bf6 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.165730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1025/2064] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:17:55.199748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f8b5426e194502a0f68fb790778ed6', 'request_id': 'req-04029468-71b2-4883-aca1-c61361556b84'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:55.211172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f8b5426e194502a0f68fb790778ed6', 'request_id': 'req-04029468-71b2-4883-aca1-c61361556b84'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:55.222754 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f8b5426e194502a0f68fb790778ed6', 'request_id': 'req-04029468-71b2-4883-aca1-c61361556b84'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:55.250275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] The token cache is being invalidate because project f2f8b5426e194502a0f68fb790778ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:55.250686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:55.251548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-04029468-71b2-4883-aca1-c61361556b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:55.254093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1040/2065] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:55 2021] DELETE /identity/v3/projects/f2f8b5426e194502a0f68fb790778ed6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:55.259757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd23e-2285-4184-8137-0542f1f63e41 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.260103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd23e-2285-4184-8137-0542f1f63e41 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.260351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bd23e-2285-4184-8137-0542f1f63e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.286328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0d1bd23e-2285-4184-8137-0542f1f63e41 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:55.286934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0d1bd23e-2285-4184-8137-0542f1f63e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:55.441443 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1026/2066] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:55.453822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.454983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.457406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.495242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:55.496954 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:55.507571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1041/2067] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:55.515779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bd23e-2285-4184-8137-0542f1f63e41 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.546361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.552819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bd23e-2285-4184-8137-0542f1f63e41 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.555045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:55.573870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.575088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.575417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.575861 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.576885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:55.577271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.581303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.599410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1027/2068] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:17:55.605952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.619120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1d0026-570f-4b1a-8449-4864ab76e9d2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.634358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.635068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.635561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.635917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.638627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.643623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.690402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1028/2069] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:55 2021] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:17:55.695389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.699466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47b32d-d8cc-4d48-8b04-d641d1dc92c5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.769616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.774455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.774936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.775342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.777914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:55.809633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0fc26-802a-4818-96f1-4ecde79d09fb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.833559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.835582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.835582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.835961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.836634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.843390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.893244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1029/2070] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:55 2021] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:55.895901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.899345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:55.908568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.910451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.920685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1042/2071] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:55 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:55.921598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.922678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddc354-1946-491e-92a5-a78b6adb420a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.931782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.932997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.933515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.934195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] PATH_INFO: `/v3/projects/dce0880e06e6461abce365056c197672` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.934383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c2688-c204-448d-81b0-525f2efa38e5 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.937244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce0880e06e6461abce365056c197672)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.939854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.940698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.940855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.940991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.941310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.942404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.943677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:55.956160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1043/2072] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:55 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:55.960488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:55.971235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2930cd3-60ad-4c9e-a9b6-822fb73b109a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:55.979114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:55.979816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:55.980164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:55.980632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:55.981469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:55.983146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:56.008779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1044/2073] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:55 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:56.014032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:56.025538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce0880e06e6461abce365056c197672', 'request_id': 'req-491487d9-ea54-413c-ba42-05885e8b7756'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.034373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce0880e06e6461abce365056c197672', 'request_id': 'req-491487d9-ea54-413c-ba42-05885e8b7756'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.042829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce0880e06e6461abce365056c197672', 'request_id': 'req-491487d9-ea54-413c-ba42-05885e8b7756'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.045890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c4db0-fd13-4aea-a9c2-340f4670fe57 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:56.063759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] The token cache is being invalidate because project dce0880e06e6461abce365056c197672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:56.064228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.065235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.074417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1030/2074] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:55 2021] DELETE /identity/v3/projects/dce0880e06e6461abce365056c197672 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:56.074417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:56.076390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:56.170958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491487d9-ea54-413c-ba42-05885e8b7756 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:56.176820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:56.178035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:56.178422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:56.178803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] PATH_INFO: `/v3/users/3222758f02ed4bbfb7dd0eb1d9986816` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:56.181295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3222758f02ed4bbfb7dd0eb1d9986816)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:56.184090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:56.200824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3543bc6-3d54-4d6e-92e7-daa93e7ab4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:56.203675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543bc6-3d54-4d6e-92e7-daa93e7ab4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:56.204586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543bc6-3d54-4d6e-92e7-daa93e7ab4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:56.218180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3543bc6-3d54-4d6e-92e7-daa93e7ab4c0 admin admin] PATH_INFO: `/v3/projects/7abc18a290264877b7cce57e27056ccf/users/c8fe1f34da024d0b8151c6f6760504ad/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:56.245588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543bc6-3d54-4d6e-92e7-daa93e7ab4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abc18a290264877b7cce57e27056ccf, user_id=c8fe1f34da024d0b8151c6f6760504ad, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:56.252195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3543bc6-3d54-4d6e-92e7-daa93e7ab4c0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:56.276720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1045/2075] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:56 2021] PUT /identity/v3/projects/7abc18a290264877b7cce57e27056ccf/users/c8fe1f34da024d0b8151c6f6760504ad/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:17:56.284236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:56.284603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:56.284944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:56.316673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3222758f02ed4bbfb7dd0eb1d9986816'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.318669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3222758f02ed4bbfb7dd0eb1d9986816'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.327742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:56.329421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:56.338046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3222758f02ed4bbfb7dd0eb1d9986816'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.354348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3222758f02ed4bbfb7dd0eb1d9986816'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.367202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3222758f02ed4bbfb7dd0eb1d9986816'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:56.382922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1031/2076] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:56 2021] DELETE /identity/v3/users/3222758f02ed4bbfb7dd0eb1d9986816 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:56.531260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1046/2077] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:56.550486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:56.552973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:56.721859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ccd524-ffca-4162-8720-5409700a402c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:56.737340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9394a7-d29e-4823-8446-cc4d2fee6336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:56.739475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9394a7-d29e-4823-8446-cc4d2fee6336 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:56.740062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9394a7-d29e-4823-8446-cc4d2fee6336 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:56.740615 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9394a7-d29e-4823-8446-cc4d2fee6336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:56.864504 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9394a7-d29e-4823-8446-cc4d2fee6336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:56.866768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9394a7-d29e-4823-8446-cc4d2fee6336 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:56.881544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1032/2078] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:17:56.985972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:56.989151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:57.023665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cb4d1-f0d0-4680-b252-eea41bc9db2a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:57.033770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:57.035889 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:57.036351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:57.036897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] PATH_INFO: `/v3/projects/84d4053b7b29491fa527cf0d71c70797` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:57.040074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d4053b7b29491fa527cf0d71c70797)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:57.048094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:57.178351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d4053b7b29491fa527cf0d71c70797', 'request_id': 'req-9a37b25c-5636-4485-9ade-b222818fdac9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:57.192884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d4053b7b29491fa527cf0d71c70797', 'request_id': 'req-9a37b25c-5636-4485-9ade-b222818fdac9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:57.227797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d4053b7b29491fa527cf0d71c70797', 'request_id': 'req-9a37b25c-5636-4485-9ade-b222818fdac9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:57.263745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] The token cache is being invalidate because project 84d4053b7b29491fa527cf0d71c70797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:17:57.264195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:57.268253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9a37b25c-5636-4485-9ade-b222818fdac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:57.276470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1047/2079] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:17:56 2021] DELETE /identity/v3/projects/84d4053b7b29491fa527cf0d71c70797 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:57.286397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887fe2-8594-4d26-a723-7f38cdf7a6e4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:57.289135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887fe2-8594-4d26-a723-7f38cdf7a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:57.290314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd887fe2-8594-4d26-a723-7f38cdf7a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:57.395201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cd887fe2-8594-4d26-a723-7f38cdf7a6e4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:57.419302 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cd887fe2-8594-4d26-a723-7f38cdf7a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:57.660425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1033/2080] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:57.675152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:57.675417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:57.675856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:57.731334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:57.734461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:57.767168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1048/2081] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:57.768930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887fe2-8594-4d26-a723-7f38cdf7a6e4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:57.816962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd887fe2-8594-4d26-a723-7f38cdf7a6e4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:57.838344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:57.840210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:57.841395 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:57.842099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:57.843811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:17:57.845411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:57.854622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:57.872601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:57.885744 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:57.933079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1034/2082] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:17:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:17:57.943699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:57.987649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570dd8e6-c6af-443b-8ad1-424b0638883e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:57.994588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:57.995583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:57.996052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:57.996862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:57.999066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:58.002413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:58.075068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1035/2083] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:17:57 2021] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:58.082128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:58.126156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bba3f2-8301-4360-a0b2-ba99ee0c59cd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:58.195587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17d41-c34b-47e1-817f-b85a6842230f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:58.205271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ccfba-c6d6-43d8-a115-1a5c891e133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:58.207594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccfba-c6d6-43d8-a115-1a5c891e133c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.208381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccfba-c6d6-43d8-a115-1a5c891e133c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.208760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ccfba-c6d6-43d8-a115-1a5c891e133c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.209977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ccfba-c6d6-43d8-a115-1a5c891e133c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:58.211970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ccfba-c6d6-43d8-a115-1a5c891e133c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:58.234975 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:58.236385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.236672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.236940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.239093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:58.240814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1036/2084] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:17:58 2021] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:17:58.242797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378bc0d-9f37-4744-97aa-d739b6740a77 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.243194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378bc0d-9f37-4744-97aa-d739b6740a77 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.243563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378bc0d-9f37-4744-97aa-d739b6740a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.300905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-d378bc0d-9f37-4744-97aa-d739b6740a77 None None] MFA Rules not processed for user `681c813529d941f688bff8333ad3b089`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:58.306421 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d378bc0d-9f37-4744-97aa-d739b6740a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:58.331258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:58.341967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:58.353209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1049/2085] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:57 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:58.354332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:58.366444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60dd71-9b67-4259-be48-91aab61ccc3e service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:58.378657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:58.379608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.380011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.380385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.381654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:58.383545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:58.398446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1050/2086] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:58 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:58.404628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:58.419866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826581cb-8219-4e78-aa44-4d8cf4acd31d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:58.428041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b83f69-e332-43c0-8b49-8c1669979c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:58.429114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83f69-e332-43c0-8b49-8c1669979c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.429652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83f69-e332-43c0-8b49-8c1669979c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.430416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b83f69-e332-43c0-8b49-8c1669979c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.431758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b83f69-e332-43c0-8b49-8c1669979c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:58.433472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1037/2087] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:58 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:58.434946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b83f69-e332-43c0-8b49-8c1669979c81 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:58.453354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1051/2088] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:17:58 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:17:58.472495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378bc0d-9f37-4744-97aa-d739b6740a77 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:58.494315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378bc0d-9f37-4744-97aa-d739b6740a77 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:58.506174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a120d-dc6f-458e-9ce2-0535b531c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:58.516100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a120d-dc6f-458e-9ce2-0535b531c931 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.516100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a120d-dc6f-458e-9ce2-0535b531c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.516100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a120d-dc6f-458e-9ce2-0535b531c931 admin admin] PATH_INFO: `/v3/projects/965e71aba7544114b60f041e6202b694/users/f043e77f131147afbbeea23eed9037f2/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.518594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.519052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.519438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.544793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a120d-dc6f-458e-9ce2-0535b531c931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965e71aba7544114b60f041e6202b694, user_id=f043e77f131147afbbeea23eed9037f2, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:58.549698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a120d-dc6f-458e-9ce2-0535b531c931 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:58.567291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] MFA Rules not processed for user `c8fe1f34da024d0b8151c6f6760504ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:58.569227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:58.595193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1038/2089] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:17:58 2021] PUT /identity/v3/projects/965e71aba7544114b60f041e6202b694/users/f043e77f131147afbbeea23eed9037f2/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:58.615515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9326-2621-4d54-a3f1-c38523ee7fc8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:58.616304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9326-2621-4d54-a3f1-c38523ee7fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:58.616920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9326-2621-4d54-a3f1-c38523ee7fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:58.695669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5ffc9326-2621-4d54-a3f1-c38523ee7fc8 None None] MFA Rules not processed for user `f043e77f131147afbbeea23eed9037f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:58.698550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5ffc9326-2621-4d54-a3f1-c38523ee7fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:58.771896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1052/2090] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:58 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:58.902496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:58.905226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:58.939235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8e303-f640-478b-8219-abe246988c98 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:58.968201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1039/2091] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:58 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:17:59.053188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:59.054678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:59.055128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:59.055623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:59.183283 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:59.187407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:59.207169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1053/2092] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:58 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:17:59.246351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9326-2621-4d54-a3f1-c38523ee7fc8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:59.269997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9326-2621-4d54-a3f1-c38523ee7fc8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:59.276216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e9f30-3d3d-4183-8ebf-2ef015f717ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:59.277374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9f30-3d3d-4183-8ebf-2ef015f717ed service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:59.277891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9f30-3d3d-4183-8ebf-2ef015f717ed service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:59.278366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e9f30-3d3d-4183-8ebf-2ef015f717ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:59.297968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e9f30-3d3d-4183-8ebf-2ef015f717ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:59.300096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e9f30-3d3d-4183-8ebf-2ef015f717ed service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:59.311439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1040/2093] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:59 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:17:59.344521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:59.451872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17013103-3e70-4865-9fcf-653bdcef0f89 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:59.458926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:59.460319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:59.461002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:59.461595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] PATH_INFO: `/v3/users/f043e77f131147afbbeea23eed9037f2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:59.464102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f043e77f131147afbbeea23eed9037f2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:59.467735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:17:59.550288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f043e77f131147afbbeea23eed9037f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:59.551071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f043e77f131147afbbeea23eed9037f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:59.567858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f043e77f131147afbbeea23eed9037f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:59.600821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f043e77f131147afbbeea23eed9037f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:59.624447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f043e77f131147afbbeea23eed9037f2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:17:59.653395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1054/2094] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:59 2021] DELETE /identity/v3/users/f043e77f131147afbbeea23eed9037f2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:17:59.659924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:59.660638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:59.666852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:59.729940 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:17:59.733038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:59.776428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:59.781832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:59.894053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1041/2095] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:17:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:17:59.910765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:17:59.920346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:17:59.930180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d7c82-72ce-48d6-afab-b16f6b34105f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:17:59.941099 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:17:59.942835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:17:59.944742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:17:59.945417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] PATH_INFO: `/v3/users/c96b4f73690e46799e1d7468554e3fcb` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:17:59.948503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96b4f73690e46799e1d7468554e3fcb)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:17:59.952863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:00.067603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96b4f73690e46799e1d7468554e3fcb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:00.068690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4f318-7eb2-4990-859f-cecc60599013 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:00.069242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96b4f73690e46799e1d7468554e3fcb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:00.081865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de878d61-757c-4b5b-8475-9a1eb8b12f94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:00.083316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de878d61-757c-4b5b-8475-9a1eb8b12f94 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:00.083802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de878d61-757c-4b5b-8475-9a1eb8b12f94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:00.084536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de878d61-757c-4b5b-8475-9a1eb8b12f94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:00.089088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96b4f73690e46799e1d7468554e3fcb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:00.101611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de878d61-757c-4b5b-8475-9a1eb8b12f94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:00.102973 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de878d61-757c-4b5b-8475-9a1eb8b12f94 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:00.119436 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96b4f73690e46799e1d7468554e3fcb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:00.124627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1042/2096] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:17:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:00.165948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96b4f73690e46799e1d7468554e3fcb'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:00.182142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1055/2097] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:17:59 2021] DELETE /identity/v3/users/c96b4f73690e46799e1d7468554e3fcb => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:00.193664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b31ba-7658-43bc-8723-1c18ebb1ed83 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:00.193664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b31ba-7658-43bc-8723-1c18ebb1ed83 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:00.193664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b31ba-7658-43bc-8723-1c18ebb1ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:00.215777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-db0b31ba-7658-43bc-8723-1c18ebb1ed83 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:00.217920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-db0b31ba-7658-43bc-8723-1c18ebb1ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:00.360827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1043/2098] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:00.378600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:00.380691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:00.635052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e5276-2054-455a-811f-9e5e5efac8b3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:00.659650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:00.662658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:00.666885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:00.666885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:00.701624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:00.723612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:00.769123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1056/2099] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:00.969883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51034-7a46-43d6-bbad-2beb71122286 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:00.970396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51034-7a46-43d6-bbad-2beb71122286 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:00.970743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51034-7a46-43d6-bbad-2beb71122286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:01.025572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c1d51034-7a46-43d6-bbad-2beb71122286 None None] MFA Rules not processed for user `c8fe1f34da024d0b8151c6f6760504ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:01.027232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1d51034-7a46-43d6-bbad-2beb71122286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:01.123988 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1044/2100] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:00 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:01.162299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:01.164615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:01.200985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927787a-f436-4c45-b91b-5f11fae705ac service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:01.211374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:01.213101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:01.213932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:01.217375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] PATH_INFO: `/v3/projects/965e71aba7544114b60f041e6202b694` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:01.219404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=965e71aba7544114b60f041e6202b694)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:01.222420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:01.335703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965e71aba7544114b60f041e6202b694', 'request_id': 'req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:01.357136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965e71aba7544114b60f041e6202b694', 'request_id': 'req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:01.386882 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965e71aba7544114b60f041e6202b694', 'request_id': 'req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:01.421794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] The token cache is being invalidate because project 965e71aba7544114b60f041e6202b694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:01.422839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:01.424260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d8cf52d-4cd1-49c3-ba01-8c437ee002ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:01.433555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1057/2101] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:01 2021] DELETE /identity/v3/projects/965e71aba7544114b60f041e6202b694 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:01.447469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646c327-fa39-47b1-ac7c-6e8334a79615 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:01.452689 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646c327-fa39-47b1-ac7c-6e8334a79615 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:01.453851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646c327-fa39-47b1-ac7c-6e8334a79615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:01.507134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c646c327-fa39-47b1-ac7c-6e8334a79615 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:01.508956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c646c327-fa39-47b1-ac7c-6e8334a79615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:01.603803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1045/2102] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:01.608185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb898de6-88fe-451d-b253-7f779691d72f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:01.610585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb898de6-88fe-451d-b253-7f779691d72f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:01.611287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb898de6-88fe-451d-b253-7f779691d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:01.678777 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fb898de6-88fe-451d-b253-7f779691d72f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:01.681329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fb898de6-88fe-451d-b253-7f779691d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:01.703015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1058/2103] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:01.704480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646c327-fa39-47b1-ac7c-6e8334a79615 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:01.725097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646c327-fa39-47b1-ac7c-6e8334a79615 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:01.738503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:01.739798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:01.741332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:01.741868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:01.743319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:01.743875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:01.747103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:01.771581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1046/2104] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:18:01.777921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb898de6-88fe-451d-b253-7f779691d72f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:01.795361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb898de6-88fe-451d-b253-7f779691d72f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:01.819580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:01.820924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:01.821239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:01.821658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:01.831649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:01.831649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:01.886331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1059/2105] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:01 2021] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:01.887814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:01.895529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:01.900334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:01.933636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f10ccd-7cd8-45f4-a7c5-07dbc9668074 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:02.097356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:02.098741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.099353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.099914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.101595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:02.107890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:02.116233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4ffdc-6dd1-47b1-bd10-1e6f84678de0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:02.123829 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:02.124814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.126131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.126131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] PATH_INFO: `/v3/projects/d2568b7f18c247399110e4205b42da66` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.138842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2568b7f18c247399110e4205b42da66)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:02.145421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:02.178502 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1047/2106] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:01 2021] POST /identity/v3/users => generated 288 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:02.181713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:02.190951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:02.206647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f5336-70f9-40ff-9b60-84665881be9e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:02.212351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:02.214109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.214109 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.214816 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] PATH_INFO: `/v3/users/74235adea3324175a7eeacb2d3dab289` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.216770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74235adea3324175a7eeacb2d3dab289)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:02.219691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:02.264450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2568b7f18c247399110e4205b42da66', 'request_id': 'req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.276483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2568b7f18c247399110e4205b42da66', 'request_id': 'req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.285157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2568b7f18c247399110e4205b42da66', 'request_id': 'req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.307553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] The token cache is being invalidate because project d2568b7f18c247399110e4205b42da66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:02.309806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.310972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.313354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1060/2107] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:01 2021] DELETE /identity/v3/projects/d2568b7f18c247399110e4205b42da66 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:02.314377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:02.315800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:02.324987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74235adea3324175a7eeacb2d3dab289'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.326804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74235adea3324175a7eeacb2d3dab289'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.346720 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74235adea3324175a7eeacb2d3dab289'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.395416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74235adea3324175a7eeacb2d3dab289'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.418461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74235adea3324175a7eeacb2d3dab289'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.433680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1048/2108] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:02 2021] DELETE /identity/v3/users/74235adea3324175a7eeacb2d3dab289 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:02.435290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:02.445085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:02.469067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a97f9f-4e7f-472f-9d12-6e11e0ba3aaa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:02.558917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:02.560151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.560151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.560363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.561456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:02.563223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:02.566360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f22ca-47d6-451b-8584-b82db0a5a881 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:02.581485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1061/2109] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:02 2021] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:02.587988 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:02.589054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:02.589529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.590365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.591072 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] PATH_INFO: `/v3/users/fa5ba2a8bd4940978322fa6edcb1650d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.595529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:02.601135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5ba2a8bd4940978322fa6edcb1650d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:02.610857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:02.624640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85027fac-fb7c-4263-a2b7-f19405155ee4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:02.641866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:02.642801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.642932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.643150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.644447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:02.646215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:02.669739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1062/2110] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:02 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:02.670981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:02.684366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3b4ac-cc6f-421d-8846-654bc16ec813 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:02.690461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17fd36-78f1-41e7-af63-5f4fe6e4f84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:02.691883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17fd36-78f1-41e7-af63-5f4fe6e4f84f admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.692177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17fd36-78f1-41e7-af63-5f4fe6e4f84f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.692443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17fd36-78f1-41e7-af63-5f4fe6e4f84f admin admin] PATH_INFO: `/v3/projects/9dd17d33e39d4d719a978fe26d5ccb1d/users/6dc7dece370545dcb785dc4ce56fc717/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.730468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17fd36-78f1-41e7-af63-5f4fe6e4f84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd17d33e39d4d719a978fe26d5ccb1d, user_id=6dc7dece370545dcb785dc4ce56fc717, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:02.742945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa17fd36-78f1-41e7-af63-5f4fe6e4f84f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:02.783352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5ba2a8bd4940978322fa6edcb1650d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.785119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1063/2111] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:02 2021] PUT /identity/v3/projects/9dd17d33e39d4d719a978fe26d5ccb1d/users/6dc7dece370545dcb785dc4ce56fc717/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:02.786517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5ba2a8bd4940978322fa6edcb1650d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.804767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:02.810570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:02.810828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:02.818842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5ba2a8bd4940978322fa6edcb1650d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.850415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5ba2a8bd4940978322fa6edcb1650d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.877266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5ba2a8bd4940978322fa6edcb1650d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:02.893335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1049/2112] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:02 2021] DELETE /identity/v3/users/fa5ba2a8bd4940978322fa6edcb1650d => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:02.946241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] MFA Rules not processed for user `6dc7dece370545dcb785dc4ce56fc717`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:02.949911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:03.130676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1064/2113] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:02 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:03.150678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:03.153896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:03.212313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:03.217985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:03.261881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389938ce-28fa-4e8d-ad9c-7d00c74fab5d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:03.276772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b5a19-a2a9-4ccb-ac6d-359c0893302d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:03.288264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5a19-a2a9-4ccb-ac6d-359c0893302d service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:03.288588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5a19-a2a9-4ccb-ac6d-359c0893302d service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:03.289089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b5a19-a2a9-4ccb-ac6d-359c0893302d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:03.308910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5a19-a2a9-4ccb-ac6d-359c0893302d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:03.311334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b5a19-a2a9-4ccb-ac6d-359c0893302d service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:03.332963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1050/2114] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:03 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:03.400188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b9cba-bd09-4e87-b73d-b5581852f534 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:03.425923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:03.427807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:03.428336 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:03.428831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] PATH_INFO: `/v3/projects/b9840e08acad4f96a65962ff11498530` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:03.433962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9840e08acad4f96a65962ff11498530)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:03.450417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:03.589214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9840e08acad4f96a65962ff11498530', 'request_id': 'req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:03.635480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9840e08acad4f96a65962ff11498530', 'request_id': 'req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:03.672541 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9840e08acad4f96a65962ff11498530', 'request_id': 'req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:03.710515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] The token cache is being invalidate because project b9840e08acad4f96a65962ff11498530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:03.710790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:03.715401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:03.722034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1065/2115] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:03 2021] DELETE /identity/v3/projects/b9840e08acad4f96a65962ff11498530 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:03.728476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcbc12-007c-4663-83eb-1e7ebca06a8e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:03.729285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcbc12-007c-4663-83eb-1e7ebca06a8e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:03.729285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcbc12-007c-4663-83eb-1e7ebca06a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:03.757854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b1bcbc12-007c-4663-83eb-1e7ebca06a8e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:03.760695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b1bcbc12-007c-4663-83eb-1e7ebca06a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:03.927823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:03.929370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:04.044012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1051/2116] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:04.132642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f59337-8ed6-4ca5-a29e-233a8682ba20 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.132974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f59337-8ed6-4ca5-a29e-233a8682ba20 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.133531 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f59337-8ed6-4ca5-a29e-233a8682ba20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.173066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-78f59337-8ed6-4ca5-a29e-233a8682ba20 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:04.174771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-78f59337-8ed6-4ca5-a29e-233a8682ba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:04.191068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1052/2117] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:04.192194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f59337-8ed6-4ca5-a29e-233a8682ba20 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:04.196267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582cc3-adbe-4e24-af88-416dd3a8b7f7 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.204732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.205716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.206047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.206327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] PATH_INFO: `/v3/projects/b3f2fbb77f944fd9ae1f99a69d2183b5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.207727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f2fbb77f944fd9ae1f99a69d2183b5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.210159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.214994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f59337-8ed6-4ca5-a29e-233a8682ba20 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.221392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.222153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.222438 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.222715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.223490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:04.223796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.226607 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.242047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1053/2118] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:04.281880 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:04.305244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2212bba-8ec7-4e68-b658-2e61c01ad2f2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.312486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.313516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.313985 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.314423 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.315518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.318656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.411117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1054/2119] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:04 2021] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:04.415346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:04.452925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f2fbb77f944fd9ae1f99a69d2183b5', 'request_id': 'req-d721c579-90cb-44b4-86c5-2dc2d9468d07'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.471915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f2fbb77f944fd9ae1f99a69d2183b5', 'request_id': 'req-d721c579-90cb-44b4-86c5-2dc2d9468d07'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.482066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f2fbb77f944fd9ae1f99a69d2183b5', 'request_id': 'req-d721c579-90cb-44b4-86c5-2dc2d9468d07'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.510261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] The token cache is being invalidate because project b3f2fbb77f944fd9ae1f99a69d2183b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:04.510868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.511898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.514433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1066/2120] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:03 2021] DELETE /identity/v3/projects/b3f2fbb77f944fd9ae1f99a69d2183b5 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:04.519476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:04.521194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:04.679983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682f22b-7acb-491f-9ef6-656fbd226bcc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.686186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.686897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.688396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.688396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.688895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.691143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.698927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721c579-90cb-44b4-86c5-2dc2d9468d07 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.707231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.708789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.709104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.709419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] PATH_INFO: `/v3/users/be8e8a482b404dcea681c0d958d81655` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.711043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be8e8a482b404dcea681c0d958d81655)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.713747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.728101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1055/2121] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:04 2021] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:04.729754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:04.732744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:04.758065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11af9ba-42ef-487f-af73-83da1a91478c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.765097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.765883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.766200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.766571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.767904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.770925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.801675 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1056/2122] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:04 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:18:04.811874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:04.812978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be8e8a482b404dcea681c0d958d81655'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.814186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be8e8a482b404dcea681c0d958d81655'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.829603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be8e8a482b404dcea681c0d958d81655'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.830486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0388dd8-ec86-44c8-b944-4d538da5debf admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.835987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.836933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.837213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.837543 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.838313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.840094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.849794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be8e8a482b404dcea681c0d958d81655'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.854989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1057/2123] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:04 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:04.860680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:04.861889 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-83ca4439-e1a7-4ef4-b53f-6d087c07ee84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be8e8a482b404dcea681c0d958d81655'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:04.870292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1067/2124] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:04 2021] DELETE /identity/v3/users/be8e8a482b404dcea681c0d958d81655 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:04.872761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301d2ec-2fb0-499e-9795-c5c246ba1ce4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:04.946175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:04.947896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:04.948198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:04.948460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] PATH_INFO: `/v3/projects/767a18b5f25c4f45b62a1a780f494b8e/users/34e0d7ecf47842d089d157c91bf80d57/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:04.968787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=767a18b5f25c4f45b62a1a780f494b8e, user_id=34e0d7ecf47842d089d157c91bf80d57, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:04.972147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:04.992010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1058/2125] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:04 2021] PUT /identity/v3/projects/767a18b5f25c4f45b62a1a780f494b8e/users/34e0d7ecf47842d089d157c91bf80d57/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:05.004449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:05.005145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:05.005611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:05.073206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] MFA Rules not processed for user `34e0d7ecf47842d089d157c91bf80d57`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:05.075833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:05.195131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:05.198761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:05.292200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1068/2126] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:05 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:05.315803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:05.321908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:05.405376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc8cc9f-3227-4842-9361-16b36825e7c2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:05.414795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:05.415730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:05.416033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:05.416306 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] PATH_INFO: `/v3/users/66c27f209ec34b8591f6fbbe3540937c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:05.418305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=66c27f209ec34b8591f6fbbe3540937c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:05.421866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:05.531577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66c27f209ec34b8591f6fbbe3540937c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:05.532836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66c27f209ec34b8591f6fbbe3540937c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:05.538822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57c475-d622-4d52-abb6-2f9094f1945d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:05.547277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66c27f209ec34b8591f6fbbe3540937c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:05.548289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279131b-038a-40b9-bbb6-8ca5a0743e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:05.549544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279131b-038a-40b9-bbb6-8ca5a0743e3e service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:05.549951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279131b-038a-40b9-bbb6-8ca5a0743e3e service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:05.550324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279131b-038a-40b9-bbb6-8ca5a0743e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:05.563333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279131b-038a-40b9-bbb6-8ca5a0743e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:05.565746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279131b-038a-40b9-bbb6-8ca5a0743e3e service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:05.578912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66c27f209ec34b8591f6fbbe3540937c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:05.589657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1069/2127] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:05 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:05.591341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:05.591663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:05.591970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:05.611234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b849053d-948c-40f7-a2f3-9907504d38bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66c27f209ec34b8591f6fbbe3540937c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:05.630144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] MFA Rules not processed for user `6dc7dece370545dcb785dc4ce56fc717`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:05.632070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1059/2128] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:05 2021] DELETE /identity/v3/users/66c27f209ec34b8591f6fbbe3540937c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:05.633068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:05.638874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:05.639167 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:05.639578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:05.706951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:05.708681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:05.850411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1070/2129] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:05 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:05.850411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:05.854682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:05.862537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1060/2130] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:05.881503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:05.883156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:05.907198 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93147-d9e5-4a15-ae23-f34919ad4c33 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:05.921784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:05.922738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:05.923022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:05.923302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] PATH_INFO: `/v3/projects/d5d76151f3014a71b93060f37db77e00` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:05.924918 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d76151f3014a71b93060f37db77e00)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:05.927051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:05.997294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e511b-c8da-4ceb-9b4a-dbe7a328b21d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:06.001525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eace731-0983-450d-9ba2-c157ba409934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:06.002211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eace731-0983-450d-9ba2-c157ba409934 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.002793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eace731-0983-450d-9ba2-c157ba409934 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.003381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eace731-0983-450d-9ba2-c157ba409934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.015950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eace731-0983-450d-9ba2-c157ba409934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:06.017823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eace731-0983-450d-9ba2-c157ba409934 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:06.035567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1061/2131] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:18:06.099164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d76151f3014a71b93060f37db77e00', 'request_id': 'req-07df3676-1dc8-4c63-b2de-f6538f21f547'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:06.117059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d76151f3014a71b93060f37db77e00', 'request_id': 'req-07df3676-1dc8-4c63-b2de-f6538f21f547'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:06.128398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d76151f3014a71b93060f37db77e00', 'request_id': 'req-07df3676-1dc8-4c63-b2de-f6538f21f547'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:06.161390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] The token cache is being invalidate because project d5d76151f3014a71b93060f37db77e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:06.162104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:06.166529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-07df3676-1dc8-4c63-b2de-f6538f21f547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:06.181612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f38fc-4ab0-4df2-8b19-ebabe36ea1e7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.182100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1071/2132] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:05 2021] DELETE /identity/v3/projects/d5d76151f3014a71b93060f37db77e00 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:06.182304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f38fc-4ab0-4df2-8b19-ebabe36ea1e7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.182712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f38fc-4ab0-4df2-8b19-ebabe36ea1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.206554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6b6f38fc-4ab0-4df2-8b19-ebabe36ea1e7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:06.208090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6b6f38fc-4ab0-4df2-8b19-ebabe36ea1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:06.329653 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1062/2133] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:06.337555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a844ed-2e41-450f-a64c-83d8811b82b5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.338101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a844ed-2e41-450f-a64c-83d8811b82b5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.338604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a844ed-2e41-450f-a64c-83d8811b82b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.409774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-39a844ed-2e41-450f-a64c-83d8811b82b5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:06.412752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-39a844ed-2e41-450f-a64c-83d8811b82b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:06.428205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1072/2134] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:06.433664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f38fc-4ab0-4df2-8b19-ebabe36ea1e7 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:06.452628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f38fc-4ab0-4df2-8b19-ebabe36ea1e7 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:06.476597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:06.482116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.482478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.482686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.483466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:06.483775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:06.486636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:06.550420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1063/2135] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:06.551471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a844ed-2e41-450f-a64c-83d8811b82b5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:06.566936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a844ed-2e41-450f-a64c-83d8811b82b5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:06.601277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:06.602054 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.602341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.602615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.603977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:06.606970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:06.643703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1073/2136] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:06 2021] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:06.647158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:06.659683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f5f64-402d-4843-bd49-fcb00567ec31 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:06.730448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:06.731341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.731341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.731573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.732342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:06.734416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:06.764387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1064/2137] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:06 2021] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:06.766361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:06.777513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d12fc-43f2-4a45-a298-320138bd8e77 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:06.783375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:06.784610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.784885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.785626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.786419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:06.788196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:06.804910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1074/2138] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:06 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:06.814359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:06.830164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d3863-30a3-4954-b870-ea7e0866ecf0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:06.837918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1802f44-d5d4-476f-9fbf-5a805019f14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:06.839317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802f44-d5d4-476f-9fbf-5a805019f14e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.841138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802f44-d5d4-476f-9fbf-5a805019f14e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.842624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1802f44-d5d4-476f-9fbf-5a805019f14e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.844247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802f44-d5d4-476f-9fbf-5a805019f14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:06.846751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1802f44-d5d4-476f-9fbf-5a805019f14e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:06.866375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:06.867170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1065/2139] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:06 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:18:06.885082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5f456-928d-4f54-8c87-6923973cc679 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:06.893533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:06.895122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.895634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.896091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] PATH_INFO: `/v3/projects/ebb073769cc346efb62d473b701d755d/users/3ea3bd2695cf4d26833d8a160c69c6f5/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:06.925662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb073769cc346efb62d473b701d755d, user_id=3ea3bd2695cf4d26833d8a160c69c6f5, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:06.931301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:06.957537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1075/2140] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:06 2021] PUT /identity/v3/projects/ebb073769cc346efb62d473b701d755d/users/3ea3bd2695cf4d26833d8a160c69c6f5/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:06.969847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375242-f05f-4f21-ac61-2ee475b6ded2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:06.970154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375242-f05f-4f21-ac61-2ee475b6ded2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:06.970424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df375242-f05f-4f21-ac61-2ee475b6ded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:07.005262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-df375242-f05f-4f21-ac61-2ee475b6ded2 None None] MFA Rules not processed for user `3ea3bd2695cf4d26833d8a160c69c6f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:07.007079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-df375242-f05f-4f21-ac61-2ee475b6ded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:07.140403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1066/2141] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:07.145892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:07.290556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859224-a484-40d1-a495-ea63ab9e2e4e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:07.303938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:07.305290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:07.305813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:07.306269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:07.307707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:07.313172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:07.360024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1076/2142] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:07 2021] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:18:07.367825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df375242-f05f-4f21-ac61-2ee475b6ded2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:07.389845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df375242-f05f-4f21-ac61-2ee475b6ded2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:07.519957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:07.521120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:07.521735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:07.522237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:07.523604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:07.527762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:07.573967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1067/2143] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:07 2021] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:07.580252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:07.599679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65dbd2-f5c7-4234-a187-d59b268048e2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:07.608124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:07.608875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:07.609347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:07.609672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:07.610460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:07.612354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:07.635791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1077/2144] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:07 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:18:07.641776 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:07.644166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:07.649032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:07.665469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e3b4-cc3b-4565-bcb3-d23db53d38db admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:07.676074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:07.677488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:07.677979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:07.678433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] PATH_INFO: `/v3/projects/57e49859784c40d9aefb271293dbec1c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:07.680536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e49859784c40d9aefb271293dbec1c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:07.681547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb98e0-b6f8-4902-a694-5b88c38d4c52 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:07.684692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:07.695442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:07.696134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:07.696659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:07.697125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:07.697761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:07.699780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:07.717745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1078/2145] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:07 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:07.726026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:07.758334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4acac4-acbe-4dda-a1ec-9b94de579d84 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:07.796326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e49859784c40d9aefb271293dbec1c', 'request_id': 'req-598ce56f-f408-4571-8f15-e83bef70d896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:07.810452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e49859784c40d9aefb271293dbec1c', 'request_id': 'req-598ce56f-f408-4571-8f15-e83bef70d896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:07.820216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e49859784c40d9aefb271293dbec1c', 'request_id': 'req-598ce56f-f408-4571-8f15-e83bef70d896'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:07.847657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] The token cache is being invalidate because project 57e49859784c40d9aefb271293dbec1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:07.848040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:07.848847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:07.855009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1068/2146] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:07 2021] DELETE /identity/v3/projects/57e49859784c40d9aefb271293dbec1c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:07.863069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:07.864881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:07.925712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a03cc5-a1ae-48db-af27-c11e2faca223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:07.927519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a03cc5-a1ae-48db-af27-c11e2faca223 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:07.928225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a03cc5-a1ae-48db-af27-c11e2faca223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:07.928716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a03cc5-a1ae-48db-af27-c11e2faca223 admin admin] PATH_INFO: `/v3/projects/8ca2510a380c49f18a0d4cb208a3306b/users/9eb9f198cc6a4cc4985e9fc6359f9254/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:07.996646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a03cc5-a1ae-48db-af27-c11e2faca223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca2510a380c49f18a0d4cb208a3306b, user_id=9eb9f198cc6a4cc4985e9fc6359f9254, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:08.002960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ce56f-f408-4571-8f15-e83bef70d896 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:08.025839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a03cc5-a1ae-48db-af27-c11e2faca223 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:08.028993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:08.029451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:08.034651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:08.035022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] PATH_INFO: `/v3/users/d069041849184ed5a4989764825ff857` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:08.037721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d069041849184ed5a4989764825ff857)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:08.049320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:08.104587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1079/2147] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:07 2021] PUT /identity/v3/projects/8ca2510a380c49f18a0d4cb208a3306b/users/9eb9f198cc6a4cc4985e9fc6359f9254/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:08.139852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df098f-a531-465e-84f6-c2484d0333a0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:08.140351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df098f-a531-465e-84f6-c2484d0333a0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:08.140828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df098f-a531-465e-84f6-c2484d0333a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:08.239040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b1df098f-a531-465e-84f6-c2484d0333a0 None None] MFA Rules not processed for user `9eb9f198cc6a4cc4985e9fc6359f9254`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:08.240757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b1df098f-a531-465e-84f6-c2484d0333a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:08.291908 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd069041849184ed5a4989764825ff857'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:08.300389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd069041849184ed5a4989764825ff857'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:08.323434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd069041849184ed5a4989764825ff857'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:08.354233 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd069041849184ed5a4989764825ff857'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:08.381201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd069041849184ed5a4989764825ff857'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:08.391559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1069/2148] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:07 2021] DELETE /identity/v3/users/d069041849184ed5a4989764825ff857 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:08.421727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1080/2149] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:08 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:08.423557 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:08.426346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:08.637471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db92943-a9b2-4953-8557-999f5705a126 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:08.677341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:08.678379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:08.678923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:08.679378 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:08.680858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:08.685994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:08.790227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1070/2150] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:08 2021] POST /identity/v3/projects => generated 375 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:08.796258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df098f-a531-465e-84f6-c2484d0333a0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.041514 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df098f-a531-465e-84f6-c2484d0333a0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:09.163963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.174648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:09.300049 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8cbaf0-af1c-41ac-a73d-1adf7544e285 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:09.305581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:09.306555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.306840 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.307116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] PATH_INFO: `/v3/projects/39e4bc64d2e3484d964d9e2eaf402e04` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.310596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e4bc64d2e3484d964d9e2eaf402e04)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:09.312702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:09.335779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:09.336798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.337206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.337654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.338681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:09.342607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:09.386207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1081/2151] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:08 2021] POST /identity/v3/users => generated 294 bytes in 588 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:09.390888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.416411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d67138-26b5-4982-a7db-575ab3abe5dc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:09.429470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e4bc64d2e3484d964d9e2eaf402e04', 'request_id': 'req-df67f234-cada-481f-bfc0-56ac4219962c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:09.446916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e4bc64d2e3484d964d9e2eaf402e04', 'request_id': 'req-df67f234-cada-481f-bfc0-56ac4219962c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:09.471853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e4bc64d2e3484d964d9e2eaf402e04', 'request_id': 'req-df67f234-cada-481f-bfc0-56ac4219962c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:09.513895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] The token cache is being invalidate because project 39e4bc64d2e3484d964d9e2eaf402e04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:09.514538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:09.515602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-df67f234-cada-481f-bfc0-56ac4219962c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:09.518987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1071/2152] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:09 2021] DELETE /identity/v3/projects/39e4bc64d2e3484d964d9e2eaf402e04 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:09.529874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176af8a-b198-4c85-99e7-4276b2c933cd None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.530361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176af8a-b198-4c85-99e7-4276b2c933cd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.532001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176af8a-b198-4c85-99e7-4276b2c933cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.571524 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:09.572211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.572673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.573379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.575883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:09.578144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:09.582735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b176af8a-b198-4c85-99e7-4276b2c933cd None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:09.585417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b176af8a-b198-4c85-99e7-4276b2c933cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:09.600608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1072/2153] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:09.605589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1082/2154] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:09.615651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.616813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c52329-55b7-4509-931e-db09f0126c26 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.617328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c52329-55b7-4509-931e-db09f0126c26 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.617864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c52329-55b7-4509-931e-db09f0126c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.621467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:09.651730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b7c52329-55b7-4509-931e-db09f0126c26 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:09.653981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b7c52329-55b7-4509-931e-db09f0126c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:09.669329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bf9c0-b652-405c-a072-3a9971c53ddc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:09.672381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1073/2155] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:09.679012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c52329-55b7-4509-931e-db09f0126c26 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.685543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:09.696353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.696818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c52329-55b7-4509-931e-db09f0126c26 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:09.696979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.697693 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] PATH_INFO: `/v3/projects/ded75241f26f4e06b681e06faff256df/users/0fdb3ac4c04b4dec94bfa4aba7fd3ce4/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.724546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:09.725766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.726100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.726564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.727915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:09.728465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:09.735178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:09.747388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded75241f26f4e06b681e06faff256df, user_id=0fdb3ac4c04b4dec94bfa4aba7fd3ce4, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:09.763792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:09.803093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1083/2156] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:09 2021] PUT /identity/v3/projects/ded75241f26f4e06b681e06faff256df/users/0fdb3ac4c04b4dec94bfa4aba7fd3ce4/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:09.804060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1074/2157] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:18:09.805953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.809740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.839253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ad294-1c8d-4472-8352-4da1399986d9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:09.944473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:09.947487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.947487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.947835 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.948857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:09.951614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:09.955897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f15bd6b-8c35-48ef-96d1-35611e3ea69d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:09.966976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:09.968338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:09.968950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:09.969500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:09.974550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1075/2158] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:09 2021] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:09.974896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:09.976236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:09.976462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:09.995044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375e3b9-429c-4948-96b6-c3c4e0ba180b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:10.004571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0161cbb-91e2-47e2-8a72-218b11053559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:10.006174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161cbb-91e2-47e2-8a72-218b11053559 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:10.006660 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161cbb-91e2-47e2-8a72-218b11053559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:10.007170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0161cbb-91e2-47e2-8a72-218b11053559 admin admin] PATH_INFO: `/v3/projects/ded75241f26f4e06b681e06faff256df/users/0fdb3ac4c04b4dec94bfa4aba7fd3ce4/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:10.010967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0161cbb-91e2-47e2-8a72-218b11053559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded75241f26f4e06b681e06faff256df, user_id=0fdb3ac4c04b4dec94bfa4aba7fd3ce4, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:10.013394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1084/2159] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:09 2021] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:10.016856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0161cbb-91e2-47e2-8a72-218b11053559 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:10.019870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:10.037215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1076/2160] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:09 2021] PUT /identity/v3/projects/ded75241f26f4e06b681e06faff256df/users/0fdb3ac4c04b4dec94bfa4aba7fd3ce4/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:10.056839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:10.057997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:10.057997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:10.121162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] MFA Rules not processed for user `0fdb3ac4c04b4dec94bfa4aba7fd3ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:10.121162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:10.175212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a031bc-4919-4e96-b7d5-5af55d49ef9e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:10.318797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1077/2161] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:10 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:10.320398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:10.327406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:10.435175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:10.436210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:10.437231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:10.437231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:10.439857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:10.444007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:10.497142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190e46f-c610-440e-8bbd-2b1f0a6a7def None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:10.510919 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:10.513157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1085/2162] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:10 2021] POST /identity/v3/users => generated 293 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:10.514408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:10.514928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:10.516051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] PATH_INFO: `/v3/users/34e0d7ecf47842d089d157c91bf80d57` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:10.517358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:10.520013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e0d7ecf47842d089d157c91bf80d57)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:10.523791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:10.528986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:10.643393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e0d7ecf47842d089d157c91bf80d57'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:10.644362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e0d7ecf47842d089d157c91bf80d57'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:10.664991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e0d7ecf47842d089d157c91bf80d57'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:10.676786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c8b9-1454-4657-8400-8db5ff30e8ec admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:10.681556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136a94b-2533-4b64-9dd8-e38f951c21be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:10.682345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136a94b-2533-4b64-9dd8-e38f951c21be service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:10.682632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136a94b-2533-4b64-9dd8-e38f951c21be service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:10.682914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136a94b-2533-4b64-9dd8-e38f951c21be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:10.685390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6136a94b-2533-4b64-9dd8-e38f951c21be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:10.703087 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e0d7ecf47842d089d157c91bf80d57'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:10.723248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e0d7ecf47842d089d157c91bf80d57'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:10.738920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1078/2163] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:10 2021] DELETE /identity/v3/users/34e0d7ecf47842d089d157c91bf80d57 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:10.744295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:10.747980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:10.767148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136a94b-2533-4b64-9dd8-e38f951c21be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:10.768796 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136a94b-2533-4b64-9dd8-e38f951c21be service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:10.795255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1086/2164] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:10 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:10.797455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29770d-d726-4fb2-89e6-cbb413f2e730 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:10.801478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29770d-d726-4fb2-89e6-cbb413f2e730 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:10.804016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29770d-d726-4fb2-89e6-cbb413f2e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:10.857873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0f29770d-d726-4fb2-89e6-cbb413f2e730 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:10.859502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0f29770d-d726-4fb2-89e6-cbb413f2e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:10.997700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61334f51-e74e-41eb-99be-17e7ea7ee834 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:11.009001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:11.010555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:11.011863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:11.012751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:11.014194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:11.018135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:11.029617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1087/2165] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:11.048904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1079/2166] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:10 2021] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:11.051530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29770d-d726-4fb2-89e6-cbb413f2e730 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:11.066404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29770d-d726-4fb2-89e6-cbb413f2e730 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:11.072331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:11.073082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:11.073485 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:11.073775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:11.075144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:11.077022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:11.081618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:11.095869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:11.106338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1088/2167] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:11 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:11.107231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:11.132985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8da87b-aa31-453d-8b28-954a0bf0d2eb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:11.157972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1433d20-103d-4030-8421-1063dd1a23e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:11.160389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433d20-103d-4030-8421-1063dd1a23e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:11.163182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433d20-103d-4030-8421-1063dd1a23e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:11.163522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1433d20-103d-4030-8421-1063dd1a23e6 admin admin] PATH_INFO: `/v3/projects/6ef8f5c840134f2aa72460ed46753739/users/07bb3a3ed1064de5a6ae0d54f0c88716/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:11.212936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1433d20-103d-4030-8421-1063dd1a23e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef8f5c840134f2aa72460ed46753739, user_id=07bb3a3ed1064de5a6ae0d54f0c88716, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:11.225394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1433d20-103d-4030-8421-1063dd1a23e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:11.273686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1089/2168] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:11 2021] PUT /identity/v3/projects/6ef8f5c840134f2aa72460ed46753739/users/07bb3a3ed1064de5a6ae0d54f0c88716/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:11.298714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac73d2-102d-4f81-be7d-7ef5303d3ac2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:11.301169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:11.303877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:11.304348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:11.391684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] MFA Rules not processed for user `07bb3a3ed1064de5a6ae0d54f0c88716`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:11.399848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:11.504380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:11.505268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:11.505801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:11.506209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:11.671370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1090/2169] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:11 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:11.687567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:11.690775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:11.700827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:11.703553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:11.729766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1080/2170] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:11.818793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b797b3-c780-4548-86b4-77ad1ca96ccd None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:11.823580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33132c34-63ba-4ec7-a4fc-2d090ce5dc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:11.824471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132c34-63ba-4ec7-a4fc-2d090ce5dc47 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:11.824758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132c34-63ba-4ec7-a4fc-2d090ce5dc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:11.825038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33132c34-63ba-4ec7-a4fc-2d090ce5dc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:11.837103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132c34-63ba-4ec7-a4fc-2d090ce5dc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:11.838771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33132c34-63ba-4ec7-a4fc-2d090ce5dc47 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:11.850426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1091/2171] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:11 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:11.872212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:11.890460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990489c-2d98-4170-9deb-bb5871f32840 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:11.898690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:11.900031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:11.900484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:11.900962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] PATH_INFO: `/v3/users/07bb3a3ed1064de5a6ae0d54f0c88716` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:11.903424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bb3a3ed1064de5a6ae0d54f0c88716)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:11.907220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:11.979052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bb3a3ed1064de5a6ae0d54f0c88716'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:11.980334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bb3a3ed1064de5a6ae0d54f0c88716'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:11.996794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bb3a3ed1064de5a6ae0d54f0c88716'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:12.018648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bb3a3ed1064de5a6ae0d54f0c88716'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:12.034674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bb3a3ed1064de5a6ae0d54f0c88716'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:12.045582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1081/2172] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:11 2021] DELETE /identity/v3/users/07bb3a3ed1064de5a6ae0d54f0c88716 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:12.050548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:12.050813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:12.051100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:12.071888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:12.073345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:12.216295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1092/2173] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:12.243314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:12.246516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:12.353637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa48f4-74b3-41e1-9500-928f4aebbdb2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:12.358797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:12.359763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:12.360115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:12.360462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:12.374935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:12.376682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:12.390744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1082/2174] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:18:12.966650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:12.968778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:13.009994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69d0b8-0536-440d-9028-767a4ea8b04a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:13.040818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:13.041753 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.042033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.042304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] PATH_INFO: `/v3/projects/767a18b5f25c4f45b62a1a780f494b8e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.045277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:13.046142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767a18b5f25c4f45b62a1a780f494b8e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:13.048019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:13.050724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:13.148447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767a18b5f25c4f45b62a1a780f494b8e', 'request_id': 'req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.159847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767a18b5f25c4f45b62a1a780f494b8e', 'request_id': 'req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.168964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767a18b5f25c4f45b62a1a780f494b8e', 'request_id': 'req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.192461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] The token cache is being invalidate because project 767a18b5f25c4f45b62a1a780f494b8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:13.199662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9451305-16c5-495e-84a9-015b708a4bd0 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:13.211411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.212590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.216452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1093/2175] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:12 2021] DELETE /identity/v3/projects/767a18b5f25c4f45b62a1a780f494b8e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:13.219704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:13.221663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:13.263737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b9c47-b7a4-427e-9723-56de1091e8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:13.264409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b9c47-b7a4-427e-9723-56de1091e8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.264687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b9c47-b7a4-427e-9723-56de1091e8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.264958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b9c47-b7a4-427e-9723-56de1091e8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.271095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c00b9c47-b7a4-427e-9723-56de1091e8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:13.350210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b9c47-b7a4-427e-9723-56de1091e8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:13.352916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b9c47-b7a4-427e-9723-56de1091e8c2 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:13.357853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad43e38-dd7f-4ee5-9dff-899743ebddd1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:13.364800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:13.365771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.366420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.366723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] PATH_INFO: `/v3/projects/6ef8f5c840134f2aa72460ed46753739` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.367322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1083/2176] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:13 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:13.368953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef8f5c840134f2aa72460ed46753739)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:13.369094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ec3d-774a-4296-8fb4-493ab3a2a553 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.369580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ec3d-774a-4296-8fb4-493ab3a2a553 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.370208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ec3d-774a-4296-8fb4-493ab3a2a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.372557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:13.396425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f396ec3d-774a-4296-8fb4-493ab3a2a553 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:13.397945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f396ec3d-774a-4296-8fb4-493ab3a2a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:13.423363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1084/2177] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:13.428573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ae2d9-15ea-4c23-bdc4-40a51cee8376 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.429418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ae2d9-15ea-4c23-bdc4-40a51cee8376 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.430486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ae2d9-15ea-4c23-bdc4-40a51cee8376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.477123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef8f5c840134f2aa72460ed46753739', 'request_id': 'req-070690c7-856e-4c72-abb6-0a4838e68dff'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.491294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef8f5c840134f2aa72460ed46753739', 'request_id': 'req-070690c7-856e-4c72-abb6-0a4838e68dff'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.508403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef8f5c840134f2aa72460ed46753739', 'request_id': 'req-070690c7-856e-4c72-abb6-0a4838e68dff'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.519337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9a1ae2d9-15ea-4c23-bdc4-40a51cee8376 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:13.521558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9a1ae2d9-15ea-4c23-bdc4-40a51cee8376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:13.552469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] The token cache is being invalidate because project 6ef8f5c840134f2aa72460ed46753739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:13.553733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.554717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-070690c7-856e-4c72-abb6-0a4838e68dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:13.562745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1094/2178] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:13 2021] DELETE /identity/v3/projects/6ef8f5c840134f2aa72460ed46753739 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:13.566776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d07ae-b9de-4819-a1d6-3b78d0fa15d8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.567937 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d07ae-b9de-4819-a1d6-3b78d0fa15d8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.568345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d07ae-b9de-4819-a1d6-3b78d0fa15d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.607072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fe7d07ae-b9de-4819-a1d6-3b78d0fa15d8 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:13.608510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fe7d07ae-b9de-4819-a1d6-3b78d0fa15d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:13.720052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1085/2179] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:13.721175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ae2d9-15ea-4c23-bdc4-40a51cee8376 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:13.732963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ae2d9-15ea-4c23-bdc4-40a51cee8376 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:13.739239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:13.739987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.740245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.740519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.741364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:13.741711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:13.744896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:13.768123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1086/2180] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:13.770100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:13.793698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df852948-8c85-49de-a6f0-f177e2df5d1d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:13.803872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1095/2181] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:13.812201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bb280-da16-45d2-a26e-f2b911d417cc None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.812498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bb280-da16-45d2-a26e-f2b911d417cc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.813014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bb280-da16-45d2-a26e-f2b911d417cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.818948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:13.819796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:13.820131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:13.820536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:13.822692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:13.831720 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:13.871393 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5a7bb280-da16-45d2-a26e-f2b911d417cc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:13.873894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1087/2182] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:13 2021] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:13.878732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:13.878977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5a7bb280-da16-45d2-a26e-f2b911d417cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:14.050341 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21164-af01-48e4-ab62-79865afcb2d6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.054714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1096/2183] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:14.063152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bb280-da16-45d2-a26e-f2b911d417cc None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.071166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.073324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.073518 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bb280-da16-45d2-a26e-f2b911d417cc None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.074535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.075005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.076298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.079508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.087425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.088341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.088863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.089087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.090310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:14.090868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.093700 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.115204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1097/2184] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:14.116347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.128323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1088/2185] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:13 2021] POST /identity/v3/users => generated 284 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:18:14.128596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa72b87-18f8-44f5-bad4-e82fceebe1b5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.128739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.137738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.138540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.138828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.139108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.140058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.143068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.158094 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdcf3f-a131-43cd-bd0b-4c5412097df3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.169899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.171972 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.172370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.173956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.174511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.193414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.197353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1098/2186] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:14 2021] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:14.206197 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.223037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1089/2187] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:14.225119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.250654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52ae4e-ddc0-4e4d-98ea-ff6d05bf53f9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.375899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.381172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435e0a2-d918-4e31-b653-51ae32dc7ee0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.383149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.383713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.384001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.384831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.386825 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.400756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1090/2188] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:14.405413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.411554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.421601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.421601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.421601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.421601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.421601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.422175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654418-2905-4647-b3a4-53acbdcf39eb admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.424287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31272055-6250-4fcf-9407-73032cf3a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.426078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272055-6250-4fcf-9407-73032cf3a059 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.426518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272055-6250-4fcf-9407-73032cf3a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.427442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31272055-6250-4fcf-9407-73032cf3a059 admin admin] PATH_INFO: `/v3/projects/a387c8bc17be4d01979488ac5ec2d550/users/287ff54b67494512b2010c17c2d715c1/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.456735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272055-6250-4fcf-9407-73032cf3a059 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a387c8bc17be4d01979488ac5ec2d550, user_id=287ff54b67494512b2010c17c2d715c1, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.460278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31272055-6250-4fcf-9407-73032cf3a059 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.466422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1099/2189] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:14 2021] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:14.468115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.509224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1091/2190] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:14 2021] PUT /identity/v3/projects/a387c8bc17be4d01979488ac5ec2d550/users/287ff54b67494512b2010c17c2d715c1/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:14.520791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858881c8-e44a-46c5-be65-a9ad592b3c6a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.521017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e368f-1f49-4d90-82c8-b987059b55cc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.521296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e368f-1f49-4d90-82c8-b987059b55cc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.521804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e368f-1f49-4d90-82c8-b987059b55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.641278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.643006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.643965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.644699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1b2e368f-1f49-4d90-82c8-b987059b55cc None None] MFA Rules not processed for user `287ff54b67494512b2010c17c2d715c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:14.644818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.646573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1b2e368f-1f49-4d90-82c8-b987059b55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:14.657248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.661851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.685858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1100/2191] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:14.685858 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.688501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:14.762838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1092/2192] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:14 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:14.767581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e368f-1f49-4d90-82c8-b987059b55cc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:14.828542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e368f-1f49-4d90-82c8-b987059b55cc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.841168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953df4b8-475b-47d2-9d7d-bbd60712d387 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:14.847075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.847759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.848273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.848467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.850455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:14.853804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:14.858838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:14.863036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:14.863656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:14.865728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:14.875209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:14.956770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1093/2193] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:14.957974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:15.001206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6f49c-2768-458c-98bb-e633a954666b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:15.016719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:15.018394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:15.021417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:15.022153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:15.025367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:15.030955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:15.079645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:15.083039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:15.138362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1101/2194] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:14 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:15.141221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:15.152824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1094/2195] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:14 2021] POST /identity/v3/projects => generated 365 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:15.160021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:15.172345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb285d5-1e5f-4b25-903b-264ec649dc7f service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:15.321491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e1cb9-3758-4f41-a4ef-888e1d21089e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:15.329087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1cb9-3758-4f41-a4ef-888e1d21089e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:15.330078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1cb9-3758-4f41-a4ef-888e1d21089e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:15.333680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e1cb9-3758-4f41-a4ef-888e1d21089e admin admin] PATH_INFO: `/v3/projects/cee2dd40b20344b996e66cff3e582c70/users/93e29465587f445fa363f19a20852288/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:15.388643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e1cb9-3758-4f41-a4ef-888e1d21089e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee2dd40b20344b996e66cff3e582c70, user_id=93e29465587f445fa363f19a20852288, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:15.399042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21e1cb9-3758-4f41-a4ef-888e1d21089e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:15.452548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1102/2196] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:15 2021] PUT /identity/v3/projects/cee2dd40b20344b996e66cff3e582c70/users/93e29465587f445fa363f19a20852288/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:15.465187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b19b-37d6-4af2-a2f6-829c3e42d383 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:15.470078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba94c5e-c008-419a-abbe-060a9ac9757a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:15.470767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba94c5e-c008-419a-abbe-060a9ac9757a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:15.471543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba94c5e-c008-419a-abbe-060a9ac9757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:15.555876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-fba94c5e-c008-419a-abbe-060a9ac9757a None None] MFA Rules not processed for user `93e29465587f445fa363f19a20852288`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:15.558573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fba94c5e-c008-419a-abbe-060a9ac9757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:15.630662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:15.634549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:15.635059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:15.635490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:15.636771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:15.642697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:15.693229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1095/2197] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:15 2021] POST /identity/v3/users => generated 289 bytes in 535 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:15.694361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:15.725573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e24afb-266e-4229-a3d7-809827364ca4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:15.744791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:15.745982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:15.746440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:15.747068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:15.748224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:15.750003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:15.758148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1103/2198] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:15 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:15.776733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba94c5e-c008-419a-abbe-060a9ac9757a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:15.799412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1096/2199] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:15.800670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:15.818241 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0cd3c-b1b6-4f56-a07b-a1dbac469d41 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:15.832355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:15.832917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:15.833202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:15.833508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] PATH_INFO: `/v3/projects/e95793d18c864cdebcdb2d17b156a000/users/a1930e42898e4deb9d377f2e5ef13b30/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:15.854647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95793d18c864cdebcdb2d17b156a000, user_id=a1930e42898e4deb9d377f2e5ef13b30, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:15.857903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:15.885958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1097/2200] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:15 2021] PUT /identity/v3/projects/e95793d18c864cdebcdb2d17b156a000/users/a1930e42898e4deb9d377f2e5ef13b30/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:15.887830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:15.889414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba94c5e-c008-419a-abbe-060a9ac9757a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:15.954897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:15.955868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:15.956253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:15.956629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.000556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab3cf5-e17d-4928-b2c9-75644578439e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:16.007518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:16.008867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.008867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:16.009256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.011751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:16.014766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:16.040820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1098/2201] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:16.042147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:16.058726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:16.060442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:16.060664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc864f96-d372-4d49-b197-10e87a27412b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:16.067686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce891-959e-4b96-86cf-6bd0a087e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:16.069204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce891-959e-4b96-86cf-6bd0a087e85c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.069204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce891-959e-4b96-86cf-6bd0a087e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:16.069745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce891-959e-4b96-86cf-6bd0a087e85c admin admin] PATH_INFO: `/v3/projects/e95793d18c864cdebcdb2d17b156a000/users/a1930e42898e4deb9d377f2e5ef13b30/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.072656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce891-959e-4b96-86cf-6bd0a087e85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95793d18c864cdebcdb2d17b156a000, user_id=a1930e42898e4deb9d377f2e5ef13b30, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:16.076555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce891-959e-4b96-86cf-6bd0a087e85c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:16.086313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1104/2202] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:15 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:16.091498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1099/2203] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:16 2021] PUT /identity/v3/projects/e95793d18c864cdebcdb2d17b156a000/users/a1930e42898e4deb9d377f2e5ef13b30/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:16.107155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.117459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:16.117459 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.117767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:16.142315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b5e09-7c73-4ca0-b771-e441cd72f50c service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:16.180063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] MFA Rules not processed for user `a1930e42898e4deb9d377f2e5ef13b30`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:16.181369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:16.257907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:16.259101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.259578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:16.259995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] PATH_INFO: `/v3/users/93e29465587f445fa363f19a20852288` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.262233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e29465587f445fa363f19a20852288)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:16.264435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:16.339751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1100/2204] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:16 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:16.349843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:16.351309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:16.356865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e29465587f445fa363f19a20852288'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:16.357898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e29465587f445fa363f19a20852288'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:16.369316 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e29465587f445fa363f19a20852288'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:16.389958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e29465587f445fa363f19a20852288'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:16.400401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-67832b58-e5a5-4c39-b9ff-4870506a5848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e29465587f445fa363f19a20852288'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:16.412009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1105/2205] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:16 2021] DELETE /identity/v3/users/93e29465587f445fa363f19a20852288 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:16.417563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.418550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:16.419156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.446521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bf899-7fc1-4b9d-8dab-f9a66d35f80b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:16.457883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:16.459292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:16.541019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:16.541639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.541994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:16.542724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.545387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:16.602881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1106/2206] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:16.620187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:16.622102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:16.681411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:16.684084 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:16.699971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1101/2207] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:16 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:18:16.739209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9403c1-7303-4313-9652-d1d08c546904 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:16.743564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:16.744319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.744637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:16.744890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:16.757643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:16.759681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:16.785368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1107/2208] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:16.939898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:16.942332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:16.990592 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd009e-4b55-46c0-995b-aaef6f3906f8 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:16.997874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c9361-d509-41ae-874d-489ee86b97ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:16.999156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c9361-d509-41ae-874d-489ee86b97ec service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:16.999640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c9361-d509-41ae-874d-489ee86b97ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:17.000111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c9361-d509-41ae-874d-489ee86b97ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:17.004349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-568c9361-d509-41ae-874d-489ee86b97ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:17.104284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c9361-d509-41ae-874d-489ee86b97ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:17.106862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568c9361-d509-41ae-874d-489ee86b97ec service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:17.129573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1102/2209] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:16 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:17.613610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:17.615955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:17.640437 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7825ab8-c6c0-403b-bbfa-f5fcf4183149 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:17.654401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:17.663184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:17.663473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:17.663751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] PATH_INFO: `/v3/projects/cee2dd40b20344b996e66cff3e582c70` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:17.665330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee2dd40b20344b996e66cff3e582c70)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:17.668279 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:17.738718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee2dd40b20344b996e66cff3e582c70', 'request_id': 'req-6d54353c-954f-4942-b1c2-0db1b5f03675'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:17.751758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee2dd40b20344b996e66cff3e582c70', 'request_id': 'req-6d54353c-954f-4942-b1c2-0db1b5f03675'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:17.759038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee2dd40b20344b996e66cff3e582c70', 'request_id': 'req-6d54353c-954f-4942-b1c2-0db1b5f03675'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:17.779464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] The token cache is being invalidate because project cee2dd40b20344b996e66cff3e582c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:17.779750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:17.780619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:17.785364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1108/2210] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:17 2021] DELETE /identity/v3/projects/cee2dd40b20344b996e66cff3e582c70 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:17.794870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdebfc-b30e-458f-821f-3c0c3b4b0e93 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:17.795441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdebfc-b30e-458f-821f-3c0c3b4b0e93 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:17.795528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cdebfc-b30e-458f-821f-3c0c3b4b0e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:17.833155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-80cdebfc-b30e-458f-821f-3c0c3b4b0e93 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:17.834797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-80cdebfc-b30e-458f-821f-3c0c3b4b0e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:17.906683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:17.908067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:17.922618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1103/2211] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:17.924166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d54353c-954f-4942-b1c2-0db1b5f03675 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:17.925310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cd1c-b793-42ed-ae1c-9be056fcfc59 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:17.925730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cd1c-b793-42ed-ae1c-9be056fcfc59 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:17.926111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cd1c-b793-42ed-ae1c-9be056fcfc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:17.942821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:17.944057 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:17.945004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:17.945656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] PATH_INFO: `/v3/users/15858e29c23a42a9946add428b84cf86` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:17.948815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15858e29c23a42a9946add428b84cf86)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:17.951579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:17.953099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a487cd1c-b793-42ed-ae1c-9be056fcfc59 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:17.954381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a487cd1c-b793-42ed-ae1c-9be056fcfc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:17.964324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1104/2212] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:17.970231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487cd1c-b793-42ed-ae1c-9be056fcfc59 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:17.985457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487cd1c-b793-42ed-ae1c-9be056fcfc59 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:17.995784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:17.998575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:17.999312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.001023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.002346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:18.002346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:18.006008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:18.024458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15858e29c23a42a9946add428b84cf86'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:18.025212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15858e29c23a42a9946add428b84cf86'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:18.034752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15858e29c23a42a9946add428b84cf86'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:18.039165 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1105/2213] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:18:18.041692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:18.055663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15858e29c23a42a9946add428b84cf86'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:18.066668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626565f5-7e23-4fb6-b700-3f4dfb69fa3c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:18.092609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-813342ad-433a-47fa-902b-8ec7dc6acc9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15858e29c23a42a9946add428b84cf86'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:18.108149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:18.111792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.115093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.115472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.119914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:18.126820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:18.131245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1109/2214] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:17 2021] DELETE /identity/v3/users/15858e29c23a42a9946add428b84cf86 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:18.140236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.140562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.140852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.175439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:18.176872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:18.212655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1106/2215] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:18 2021] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:18.221626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:18.226261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:18.331006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1110/2216] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:18.340367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:18.342072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:18.385852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69937abd-1db8-4843-8ca3-7ce16db785ad admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:18.404987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:18.407243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.407977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.408518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.410351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:18.414435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:18.439928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a9d35-9197-43dc-9831-0de4820bd2c3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:18.472790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1107/2217] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:18 2021] POST /identity/v3/users => generated 281 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:18.486717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:18.509813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7fe9d-baf6-48f3-901f-ab3e575b2aa3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:18.519324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:18.519961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.520282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.520530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.522062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:18.524236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:18.532044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:18.534231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.534592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.534826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.550667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1108/2218] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:18 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:18.562746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:18.564360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:18.564518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:18.577593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1111/2219] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:18:18.597402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436607c-629e-4d49-a844-fca90acc34da admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:18.608888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86cd7e-ed36-4950-a232-24cc78e74b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:18.610051 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86cd7e-ed36-4950-a232-24cc78e74b23 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.610524 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86cd7e-ed36-4950-a232-24cc78e74b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.610999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86cd7e-ed36-4950-a232-24cc78e74b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.612498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86cd7e-ed36-4950-a232-24cc78e74b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:18.616552 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86cd7e-ed36-4950-a232-24cc78e74b23 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:18.643596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1109/2220] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:18 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:18:18.648309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:18.665631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb1ab91-3be1-4b97-8ea5-99810e88b1e9 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:18.685673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:18.686870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.687379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.687887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] PATH_INFO: `/v3/projects/6280fb37603f4197be8d7e8abd34c05e/users/c6a2959925cc45d7818180be0c911b9c/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.726405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6280fb37603f4197be8d7e8abd34c05e, user_id=c6a2959925cc45d7818180be0c911b9c, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:18.737798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:18.810252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1112/2221] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:18 2021] PUT /identity/v3/projects/6280fb37603f4197be8d7e8abd34c05e/users/c6a2959925cc45d7818180be0c911b9c/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:18.824419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684c79-0931-43ed-82a1-0efa4001bcad None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:18.825313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684c79-0931-43ed-82a1-0efa4001bcad None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:18.825677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13684c79-0931-43ed-82a1-0efa4001bcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:18.910206 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-13684c79-0931-43ed-82a1-0efa4001bcad None None] MFA Rules not processed for user `c6a2959925cc45d7818180be0c911b9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:18.912644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-13684c79-0931-43ed-82a1-0efa4001bcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:19.094435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1110/2222] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:18 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:19.109058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:19.112217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:19.268066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8dbd8-60fa-46b7-8cc9-9daa998eb546 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:19.287706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:19.289351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.289849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.290318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.338586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:19.341548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:19.355228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1113/2223] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:19 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:19.384767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13684c79-0931-43ed-82a1-0efa4001bcad None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:19.516624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:19.518175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:19.527192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13684c79-0931-43ed-82a1-0efa4001bcad None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:19.533584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:19.535055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.535345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.535622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] PATH_INFO: `/v3/users/c6a2959925cc45d7818180be0c911b9c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.537041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a2959925cc45d7818180be0c911b9c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:19.539913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:19.551595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afdaa0-aae3-45bf-a4e7-5389c9e5a7df service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:19.578497 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:19.580235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.588660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.589089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] PATH_INFO: `/v3/projects/d164854003b64baab112e8939f293e9d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.591868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d164854003b64baab112e8939f293e9d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:19.594050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:19.634189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a2959925cc45d7818180be0c911b9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.635252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a2959925cc45d7818180be0c911b9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.655370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a2959925cc45d7818180be0c911b9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.675089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a2959925cc45d7818180be0c911b9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.677248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd164854003b64baab112e8939f293e9d', 'request_id': 'req-a2420dd8-6ada-4263-9ec7-737d99b6a911'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.685608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1c07d814-620e-4fcc-8ad0-7631c6c1ad3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a2959925cc45d7818180be0c911b9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.686699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd164854003b64baab112e8939f293e9d', 'request_id': 'req-a2420dd8-6ada-4263-9ec7-737d99b6a911'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.696824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd164854003b64baab112e8939f293e9d', 'request_id': 'req-a2420dd8-6ada-4263-9ec7-737d99b6a911'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.697298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1111/2224] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:19 2021] DELETE /identity/v3/users/c6a2959925cc45d7818180be0c911b9c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:19.700598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.700919 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.701139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.713477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] The token cache is being invalidate because project d164854003b64baab112e8939f293e9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:19.713683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.714396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2420dd8-6ada-4263-9ec7-737d99b6a911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:19.716492 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1114/2225] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:19 2021] DELETE /identity/v3/projects/d164854003b64baab112e8939f293e9d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:19.722565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dff2c-b858-43bb-ade6-afe1075868f1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.722907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dff2c-b858-43bb-ade6-afe1075868f1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.723359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dff2c-b858-43bb-ade6-afe1075868f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.734139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:19.737681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:19.748382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a69dff2c-b858-43bb-ade6-afe1075868f1 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:19.749685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a69dff2c-b858-43bb-ade6-afe1075868f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:19.819030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1115/2226] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:19.828811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1f5c-214b-487b-a239-c8183476b215 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.829723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1f5c-214b-487b-a239-c8183476b215 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.830422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af1f5c-214b-487b-a239-c8183476b215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.856406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1112/2227] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:19.858839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a5af1f5c-214b-487b-a239-c8183476b215 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:19.860736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a5af1f5c-214b-487b-a239-c8183476b215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:19.872168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:19.873928 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:19.875013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1116/2228] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:19.880311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1f5c-214b-487b-a239-c8183476b215 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:19.894609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af1f5c-214b-487b-a239-c8183476b215 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:19.902812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:19.903945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.904475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.904927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.906288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:19.906793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:19.909860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:19.933748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1117/2229] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:18:19.936037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:19.950286 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6474503-7960-435b-9709-dd6621220bb8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:19.957231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:19.958741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:19.958877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:19.959130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:19.960052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:19.962806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:19.998223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48f48b-d6a0-4ba8-8790-ddfa287345cb None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:20.012212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:20.015535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.016031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.016482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.027780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1118/2230] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:19 2021] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:18:20.034572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:20.046248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:20.049196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:20.070785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1113/2231] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:18:20.073838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:20.077527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:20.110933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ecf3-6b74-4658-8a14-6e713c71039a service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:20.209789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3939b9-6e01-4af6-bfa7-5fce0285c9c4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:20.218473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:20.220692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.221290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.221831 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.222871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:20.226670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:20.273894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1119/2232] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:20 2021] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:20.281565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:20.299389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:20.301050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.301558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.302044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] PATH_INFO: `/v3/users/3ea3bd2695cf4d26833d8a160c69c6f5` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.303345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4092d-ac6c-4d3f-ba1d-d63ac3222c9b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:20.308372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea3bd2695cf4d26833d8a160c69c6f5)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:20.317420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:20.318070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:20.321020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.321716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.322106 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.323273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:20.328027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:20.400060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1120/2233] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:20.405995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:20.430849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65af58-aed8-4846-aad9-6639763d6faf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:20.446376 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:20.449396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.450995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.451538 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.453095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:20.458041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:20.480372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1121/2234] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:18:20.486708 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:20.493724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea3bd2695cf4d26833d8a160c69c6f5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:20.494918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea3bd2695cf4d26833d8a160c69c6f5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:20.518735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea3bd2695cf4d26833d8a160c69c6f5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:20.539547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1ee0b-e003-401d-9927-320b2c0c1928 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:20.553061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04014bc-ab97-4e6c-8754-58ab0e3d7730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:20.557313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea3bd2695cf4d26833d8a160c69c6f5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:20.559166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04014bc-ab97-4e6c-8754-58ab0e3d7730 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.560763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04014bc-ab97-4e6c-8754-58ab0e3d7730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.561788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04014bc-ab97-4e6c-8754-58ab0e3d7730 admin admin] PATH_INFO: `/v3/projects/5e6ca957daf741999d61ce3fd1099b9b/users/8a9ecde3498b481ebdb498616477489a/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.594005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3b344a44-b5cb-4537-b39c-d71f3649fc45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea3bd2695cf4d26833d8a160c69c6f5'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:20.625960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1114/2235] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:20 2021] DELETE /identity/v3/users/3ea3bd2695cf4d26833d8a160c69c6f5 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:20.632629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.633386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.635431 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.641707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04014bc-ab97-4e6c-8754-58ab0e3d7730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e6ca957daf741999d61ce3fd1099b9b, user_id=8a9ecde3498b481ebdb498616477489a, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:20.649162 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04014bc-ab97-4e6c-8754-58ab0e3d7730 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:20.694084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1122/2236] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:20 2021] PUT /identity/v3/projects/5e6ca957daf741999d61ce3fd1099b9b/users/8a9ecde3498b481ebdb498616477489a/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:20.708075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:20.713583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:20.714255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:20.714618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:20.715067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:20.839388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] MFA Rules not processed for user `8a9ecde3498b481ebdb498616477489a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:20.842207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:20.904947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1115/2237] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:20.959604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:20.962091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:21.101660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1123/2238] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:20 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:21.133949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:21.139951 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:21.181763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e2abb-ed9d-4f88-bfb6-0d1ca13bed3d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:21.203792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:21.205394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:21.206190 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:21.206903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:21.246570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:21.250133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:21.290822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1116/2239] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:21.291877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:21.298865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:21.333335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3606cc-3d68-48b3-b891-65dc5e3464e2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:21.344765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cd8b7-2e8c-4b80-9a5c-7a8e1d481db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:21.345577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd8b7-2e8c-4b80-9a5c-7a8e1d481db1 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:21.346170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd8b7-2e8c-4b80-9a5c-7a8e1d481db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:21.347139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cd8b7-2e8c-4b80-9a5c-7a8e1d481db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:21.352073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193d6ba-aa63-4c4a-9460-69be45c2e6c0 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:21.371899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:21.373326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cd8b7-2e8c-4b80-9a5c-7a8e1d481db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:21.373608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:21.373757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:21.374118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] PATH_INFO: `/v3/projects/6280fb37603f4197be8d7e8abd34c05e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:21.379920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6280fb37603f4197be8d7e8abd34c05e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:21.383686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:21.384780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cd8b7-2e8c-4b80-9a5c-7a8e1d481db1 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:21.430141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1124/2240] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:21 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:21.555389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6280fb37603f4197be8d7e8abd34c05e', 'request_id': 'req-9ba0384a-cbbd-41f2-89af-01f7d330691c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:21.572548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6280fb37603f4197be8d7e8abd34c05e', 'request_id': 'req-9ba0384a-cbbd-41f2-89af-01f7d330691c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:21.587377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6280fb37603f4197be8d7e8abd34c05e', 'request_id': 'req-9ba0384a-cbbd-41f2-89af-01f7d330691c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:21.633060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] The token cache is being invalidate because project 6280fb37603f4197be8d7e8abd34c05e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:21.633668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:21.634903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-9ba0384a-cbbd-41f2-89af-01f7d330691c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:21.636769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1117/2241] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:21 2021] DELETE /identity/v3/projects/6280fb37603f4197be8d7e8abd34c05e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:21.646950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24560c4-8e7c-4035-a0d0-9a3333a094cc None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:21.647408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24560c4-8e7c-4035-a0d0-9a3333a094cc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:21.647783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24560c4-8e7c-4035-a0d0-9a3333a094cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:21.695767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b24560c4-8e7c-4035-a0d0-9a3333a094cc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:21.702743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b24560c4-8e7c-4035-a0d0-9a3333a094cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:21.933472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1125/2242] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:21.948246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23af80-92fe-4585-a3fc-6def504ee69b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:21.950015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23af80-92fe-4585-a3fc-6def504ee69b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:21.950683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23af80-92fe-4585-a3fc-6def504ee69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.011819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2d23af80-92fe-4585-a3fc-6def504ee69b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:22.025594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2d23af80-92fe-4585-a3fc-6def504ee69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:22.055057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1118/2243] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:22.062096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24560c4-8e7c-4035-a0d0-9a3333a094cc None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.080567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24560c4-8e7c-4035-a0d0-9a3333a094cc None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.090045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.091357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.091933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.092517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.094351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:22.094910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.098716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.123177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1126/2244] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:22.129702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23af80-92fe-4585-a3fc-6def504ee69b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.145175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23af80-92fe-4585-a3fc-6def504ee69b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.148309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.151502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:22.159461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.160142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.160418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.161089 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.162181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.165563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.226626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa9b1b-7477-4d8f-b01b-0c0bd7da20fe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.226918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1119/2245] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:22 2021] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:18:22.228590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.336471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.337823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.338272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.338731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] PATH_INFO: `/v3/projects/ebb073769cc346efb62d473b701d755d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.340926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb073769cc346efb62d473b701d755d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.345242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.413223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff83c9-a653-402d-9bbb-b4872a9990e5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.425554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.428452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.429886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.431451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.434154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.438236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.465799 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb073769cc346efb62d473b701d755d', 'request_id': 'req-10d90297-75e1-4d23-a317-295c2f44edf0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.481100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb073769cc346efb62d473b701d755d', 'request_id': 'req-10d90297-75e1-4d23-a317-295c2f44edf0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.483257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1120/2246] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:22 2021] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:22.490691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.492980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb073769cc346efb62d473b701d755d', 'request_id': 'req-10d90297-75e1-4d23-a317-295c2f44edf0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.511699 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b202e-cc34-4318-925b-d9945b01bb6d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.521078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] The token cache is being invalidate because project ebb073769cc346efb62d473b701d755d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:22.521952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.524377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.527733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1127/2247] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:22 2021] DELETE /identity/v3/projects/ebb073769cc346efb62d473b701d755d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:22.534292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.538021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:22.617278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.618167 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.618167 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.621042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.622365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.627190 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.657492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1121/2248] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:22 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:22.660939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.663868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:22.677797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90297-75e1-4d23-a317-295c2f44edf0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.685346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.686738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.687699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.688030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] PATH_INFO: `/v3/users/9eb9f198cc6a4cc4985e9fc6359f9254` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.689615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb9f198cc6a4cc4985e9fc6359f9254)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.690246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1e328-aa6a-4765-95f5-b68aa06f5dbd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.691667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.700747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.702163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.702839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.703666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.706720 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.710714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.740412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1122/2249] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:22 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:22.741572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:22.755517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a47c0f1-2e6c-4482-af12-88e5f46948bc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:22.763393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f59fb1-7e21-4f17-a85f-ff3b90ac7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:22.764492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59fb1-7e21-4f17-a85f-ff3b90ac7f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.764954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59fb1-7e21-4f17-a85f-ff3b90ac7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.765422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f59fb1-7e21-4f17-a85f-ff3b90ac7f9c admin admin] PATH_INFO: `/v3/projects/a9f7131cbc7543f4b947ede2f88757b1/users/0f6c1cfb26c348ed9d80ed781a311587/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.802896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb9f198cc6a4cc4985e9fc6359f9254'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.803766 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb9f198cc6a4cc4985e9fc6359f9254'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.810899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59fb1-7e21-4f17-a85f-ff3b90ac7f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f7131cbc7543f4b947ede2f88757b1, user_id=0f6c1cfb26c348ed9d80ed781a311587, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:22.814636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f59fb1-7e21-4f17-a85f-ff3b90ac7f9c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:22.821906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb9f198cc6a4cc4985e9fc6359f9254'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.849587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1123/2250] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:22 2021] PUT /identity/v3/projects/a9f7131cbc7543f4b947ede2f88757b1/users/0f6c1cfb26c348ed9d80ed781a311587/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:22.851355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb9f198cc6a4cc4985e9fc6359f9254'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.855298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.856408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.856950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:22.865360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb69c0ea-8899-47fa-b348-dc841abc8e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb9f198cc6a4cc4985e9fc6359f9254'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:22.876387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1128/2251] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:22 2021] DELETE /identity/v3/users/9eb9f198cc6a4cc4985e9fc6359f9254 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:22.913680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] MFA Rules not processed for user `0f6c1cfb26c348ed9d80ed781a311587`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:22.916099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:22.978963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d578a-a079-4a34-8e99-d7b4922d2935 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:22.979439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d578a-a079-4a34-8e99-d7b4922d2935 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:22.979904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d578a-a079-4a34-8e99-d7b4922d2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:23.007832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f41d578a-a079-4a34-8e99-d7b4922d2935 None None] MFA Rules not processed for user `681c813529d941f688bff8333ad3b089`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:23.009178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f41d578a-a079-4a34-8e99-d7b4922d2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:23.136820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1124/2252] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:22 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:23.141711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.148235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:23.168187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1129/2253] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:23.298693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed09279d-6838-4da3-b705-4114610c1a2a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:23.311687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:23.313237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:23.313765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:23.314237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:23.315294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:23.318204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:23.362722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1125/2254] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:23 2021] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:23.369890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d578a-a079-4a34-8e99-d7b4922d2935 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.401385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d578a-a079-4a34-8e99-d7b4922d2935 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:23.432363 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.435147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:23.505471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:23.506232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:23.506516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:23.506798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:23.507559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:23.509637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:23.541775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1130/2255] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:23 2021] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:18:23.543885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.570358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609bb5d-5c42-474c-bedb-cbd941a694b9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:23.575321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540848d-4edd-4d18-827d-7bd991855045 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:23.579931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:23.580522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:23.581750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:23.582023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:23.582310 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:23.582587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] PATH_INFO: `/v3/projects/8ca2510a380c49f18a0d4cb208a3306b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:23.582701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:23.583438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:23.585312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:23.590276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:23.594941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca2510a380c49f18a0d4cb208a3306b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:23.597315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:23.629262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1131/2256] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:23.636639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.660410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5507de-0cb7-453a-90cb-8afac500129c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:23.680005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:23.682281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:23.682843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:23.683558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] PATH_INFO: `/v3/projects/c3f8747888084908b728b006e520902e/users/988ad9b0813c4ef58460cccca71b4e50/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:23.718233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8747888084908b728b006e520902e, user_id=988ad9b0813c4ef58460cccca71b4e50, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:23.721457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:23.729040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca2510a380c49f18a0d4cb208a3306b', 'request_id': 'req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:23.747235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca2510a380c49f18a0d4cb208a3306b', 'request_id': 'req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:23.751425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1132/2257] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:23 2021] PUT /identity/v3/projects/c3f8747888084908b728b006e520902e/users/988ad9b0813c4ef58460cccca71b4e50/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:23.758143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.777995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca2510a380c49f18a0d4cb208a3306b', 'request_id': 'req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:23.816975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] The token cache is being invalidate because project 8ca2510a380c49f18a0d4cb208a3306b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:23.817282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:23.819784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:23.825090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1126/2258] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:23 2021] DELETE /identity/v3/projects/8ca2510a380c49f18a0d4cb208a3306b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:23.829045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.837021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:23.941013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1a274-00e5-49f5-8a4f-7a57bfb06eba admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:23.957344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:23.958200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:23.958932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:23.958932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:23.959881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:23.961872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:23.984721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1133/2259] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:23 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:23.987894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab6c81-d90a-4d8f-b0b0-54462fb38768 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:23.994040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:23.996784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:24.002036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:24.003728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:24.004356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:24.004924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] PATH_INFO: `/v3/users/0fdb3ac4c04b4dec94bfa4aba7fd3ce4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:24.007492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdb3ac4c04b4dec94bfa4aba7fd3ce4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:24.012759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:24.027350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5dd6e-282e-4b7f-816c-8ae70c904a28 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:24.041712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9669c7-01de-4009-8ab5-beaa9ee2b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:24.043290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9669c7-01de-4009-8ab5-beaa9ee2b1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:24.043657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9669c7-01de-4009-8ab5-beaa9ee2b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:24.044005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9669c7-01de-4009-8ab5-beaa9ee2b1c6 admin admin] PATH_INFO: `/v3/projects/c3f8747888084908b728b006e520902e/users/988ad9b0813c4ef58460cccca71b4e50/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:24.049056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9669c7-01de-4009-8ab5-beaa9ee2b1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f8747888084908b728b006e520902e, user_id=988ad9b0813c4ef58460cccca71b4e50, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:24.052539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9669c7-01de-4009-8ab5-beaa9ee2b1c6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:24.083295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1134/2260] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:23 2021] PUT /identity/v3/projects/c3f8747888084908b728b006e520902e/users/988ad9b0813c4ef58460cccca71b4e50/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:24.101785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:24.105214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:24.106610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:24.111240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdb3ac4c04b4dec94bfa4aba7fd3ce4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:24.112638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdb3ac4c04b4dec94bfa4aba7fd3ce4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:24.142790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdb3ac4c04b4dec94bfa4aba7fd3ce4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:24.178580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdb3ac4c04b4dec94bfa4aba7fd3ce4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:24.180617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] MFA Rules not processed for user `988ad9b0813c4ef58460cccca71b4e50`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:24.182119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:24.193550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdb3ac4c04b4dec94bfa4aba7fd3ce4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:24.206734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1127/2261] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:23 2021] DELETE /identity/v3/users/0fdb3ac4c04b4dec94bfa4aba7fd3ce4 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:24.395015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1135/2262] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:24 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:24.466065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:24.467634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:24.665332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e14711-3f9f-46b8-a3d5-6c8672d8f6c8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:24.692350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:24.695707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:24.697317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:24.699213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:24.708032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:24.973486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:24.975221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:25.002881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1128/2263] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:24 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:25.099510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:25.102666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:25.244905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e7892f-3605-4416-b5fe-4e907886c00c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:25.333422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:25.335234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:25.393671 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:25.394880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:25.395234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:25.395580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] PATH_INFO: `/v3/users/287ff54b67494512b2010c17c2d715c1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:25.397101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=287ff54b67494512b2010c17c2d715c1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:25.399240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:25.509268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475bd0e-2474-46f6-9b59-8abf58276944 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:25.516249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287ff54b67494512b2010c17c2d715c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.517589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287ff54b67494512b2010c17c2d715c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.523976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:25.525995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:25.526263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:25.526524 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] PATH_INFO: `/v3/projects/ded75241f26f4e06b681e06faff256df` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:25.530101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded75241f26f4e06b681e06faff256df)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:25.533482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287ff54b67494512b2010c17c2d715c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.535596 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:25.559856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287ff54b67494512b2010c17c2d715c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.572067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bb0e5a74-7624-4730-95cf-0fab1d6ba83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287ff54b67494512b2010c17c2d715c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.584737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1136/2264] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:25 2021] DELETE /identity/v3/users/287ff54b67494512b2010c17c2d715c1 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:25.593237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:25.593484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:25.594011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:25.621945 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded75241f26f4e06b681e06faff256df', 'request_id': 'req-7a9d1766-df41-401f-b7ba-d0b5425704f0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.634557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:25.635752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:25.645228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded75241f26f4e06b681e06faff256df', 'request_id': 'req-7a9d1766-df41-401f-b7ba-d0b5425704f0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.663100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded75241f26f4e06b681e06faff256df', 'request_id': 'req-7a9d1766-df41-401f-b7ba-d0b5425704f0'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.693938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] The token cache is being invalidate because project ded75241f26f4e06b681e06faff256df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:25.694815 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.705651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a9d1766-df41-401f-b7ba-d0b5425704f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:25.708947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1129/2265] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:25 2021] DELETE /identity/v3/projects/ded75241f26f4e06b681e06faff256df => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:25.718762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102df59-b2bb-47eb-b40c-5ca8735a575b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:25.719843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102df59-b2bb-47eb-b40c-5ca8735a575b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:25.720877 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102df59-b2bb-47eb-b40c-5ca8735a575b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:25.763435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4102df59-b2bb-47eb-b40c-5ca8735a575b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:25.765943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4102df59-b2bb-47eb-b40c-5ca8735a575b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:25.788437 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1137/2266] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:25.813019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:25.818985 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:26.025106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1130/2267] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:26.037806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bfd68-cfdc-48db-9ff3-01ecf47fb1fc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.038290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bfd68-cfdc-48db-9ff3-01ecf47fb1fc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.038764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bfd68-cfdc-48db-9ff3-01ecf47fb1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.063483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c368fa-87fb-4322-866e-597ae87664bf None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:26.067764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:26.071252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.071252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.071252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.101046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:26.106273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:26.112170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-861bfd68-cfdc-48db-9ff3-01ecf47fb1fc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:26.118854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-861bfd68-cfdc-48db-9ff3-01ecf47fb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:26.142320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1138/2268] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:26.149489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1131/2269] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:26.154945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:26.170278 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44834abd-acab-42e1-ac1b-19864b3fab7f service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:26.176456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:26.177947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.178441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.179169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.181092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:26.181713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:26.184742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:26.208108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1139/2270] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:26.212532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bfd68-cfdc-48db-9ff3-01ecf47fb1fc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:26.225560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bfd68-cfdc-48db-9ff3-01ecf47fb1fc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:26.237396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:26.238721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.239254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.239975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.241587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:26.246212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:26.301888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1132/2271] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:26 2021] POST /identity/v3/projects => generated 369 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:26.307380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:26.326303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961782d-08fb-4e2e-9b80-c1b4b2104427 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:26.448398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:26.449208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.449736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.450012 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.450797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:26.452883 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:26.487107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1140/2272] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:26 2021] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:26.489334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:26.508214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213cf2-9e38-40e7-b079-ddcdf0610cc2 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:26.517033 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:26.518218 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.518621 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.518959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.519824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:26.522036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:26.546866 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1133/2273] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:26.548300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:26.559696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c31d71-b89b-4b84-9881-bfc1e7898fa8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:26.570108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd2cce-7bb8-4e25-b6f0-c0022b9cfbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:26.571107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2cce-7bb8-4e25-b6f0-c0022b9cfbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.571418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2cce-7bb8-4e25-b6f0-c0022b9cfbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.571757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd2cce-7bb8-4e25-b6f0-c0022b9cfbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.572546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2cce-7bb8-4e25-b6f0-c0022b9cfbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:26.574361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd2cce-7bb8-4e25-b6f0-c0022b9cfbc6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:26.590764 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1141/2274] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:26 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:26.592501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:26.605696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9799603-bb0c-42f7-bd64-0f376faa1b40 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:26.611987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:26.612849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.613136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.613406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] PATH_INFO: `/v3/projects/ec4cb4cfc9594548a3e294dc342b8542/users/b8a4c5d6c134466d87ac2a2781ba8aaf/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.633285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec4cb4cfc9594548a3e294dc342b8542, user_id=b8a4c5d6c134466d87ac2a2781ba8aaf, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:26.637319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:26.655987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1134/2275] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:26 2021] PUT /identity/v3/projects/ec4cb4cfc9594548a3e294dc342b8542/users/b8a4c5d6c134466d87ac2a2781ba8aaf/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:26.673703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:26.674413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:26.674683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:26.754804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] MFA Rules not processed for user `b8a4c5d6c134466d87ac2a2781ba8aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:26.757397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:26.909548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1142/2276] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:26 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:26.944550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:26.947801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:27.155238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125a5869-af2f-4826-950b-09e2b03434c0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:27.187780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:27.193604 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:27.194679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:27.195419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:27.239138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:27.240907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:27.259021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1135/2277] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:26 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:27.563481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:27.565849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:27.701782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a20d-7cb9-4617-8f81-0a6d9779750a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:27.707528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:27.708804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:27.709217 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:27.709632 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] PATH_INFO: `/v3/projects/a387c8bc17be4d01979488ac5ec2d550` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:27.711194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a387c8bc17be4d01979488ac5ec2d550)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:27.713299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:27.790361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a387c8bc17be4d01979488ac5ec2d550', 'request_id': 'req-8f15bc86-6814-49ab-a2c9-83e62e494436'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:27.802175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a387c8bc17be4d01979488ac5ec2d550', 'request_id': 'req-8f15bc86-6814-49ab-a2c9-83e62e494436'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:27.815584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a387c8bc17be4d01979488ac5ec2d550', 'request_id': 'req-8f15bc86-6814-49ab-a2c9-83e62e494436'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:27.846715 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] The token cache is being invalidate because project a387c8bc17be4d01979488ac5ec2d550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:27.847062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:27.849636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:27.852122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1143/2278] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:27 2021] DELETE /identity/v3/projects/a387c8bc17be4d01979488ac5ec2d550 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:27.857286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:27.873619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360e40c-54e5-46fd-b6a8-df63471187e0 service glance] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:27.990021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:27.991263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:27.993726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:27.994239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] PATH_INFO: `/v3/users/a1930e42898e4deb9d377f2e5ef13b30` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:27.997883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1930e42898e4deb9d377f2e5ef13b30)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:28.000499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:28.134506 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1930e42898e4deb9d377f2e5ef13b30'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.139654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1930e42898e4deb9d377f2e5ef13b30'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.163540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1930e42898e4deb9d377f2e5ef13b30'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.200916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1930e42898e4deb9d377f2e5ef13b30'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.226423 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1930e42898e4deb9d377f2e5ef13b30'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.240035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1136/2279] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:27 2021] DELETE /identity/v3/users/a1930e42898e4deb9d377f2e5ef13b30 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:28.426471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:28.429080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:28.460636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f15bc86-6814-49ab-a2c9-83e62e494436 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:28.577032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:28.580482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:28.580844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:28.581194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] PATH_INFO: `/v3/users/0f6c1cfb26c348ed9d80ed781a311587` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:28.590304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6c1cfb26c348ed9d80ed781a311587)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:28.596259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:28.615440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:28.617064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:28.639709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5de1a-b1e0-4e94-a6e8-a4e51bb552f4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:28.646762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:28.647806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:28.648221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:28.648546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] PATH_INFO: `/v3/projects/e95793d18c864cdebcdb2d17b156a000` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:28.650193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95793d18c864cdebcdb2d17b156a000)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:28.652913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:28.725778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6c1cfb26c348ed9d80ed781a311587'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.730169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6c1cfb26c348ed9d80ed781a311587'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.755061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6c1cfb26c348ed9d80ed781a311587'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.772421 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95793d18c864cdebcdb2d17b156a000', 'request_id': 'req-799037b4-424c-423e-927f-b9b8eca45a5d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.783261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6c1cfb26c348ed9d80ed781a311587'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.799162 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-33f9448f-248f-40f5-aad7-8f03b5758778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6c1cfb26c348ed9d80ed781a311587'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.800137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95793d18c864cdebcdb2d17b156a000', 'request_id': 'req-799037b4-424c-423e-927f-b9b8eca45a5d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.816786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1144/2280] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:28 2021] DELETE /identity/v3/users/0f6c1cfb26c348ed9d80ed781a311587 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:28.817281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95793d18c864cdebcdb2d17b156a000', 'request_id': 'req-799037b4-424c-423e-927f-b9b8eca45a5d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.823778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:28.827443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:28.828348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:28.856203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] The token cache is being invalidate because project e95793d18c864cdebcdb2d17b156a000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:28.856685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.862188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-799037b4-424c-423e-927f-b9b8eca45a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:28.867600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1137/2281] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:28 2021] DELETE /identity/v3/projects/e95793d18c864cdebcdb2d17b156a000 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:28.877572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:28.880310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:28.882805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed3a3-c5dc-49d3-b204-90d6b34df076 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:28.886516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed3a3-c5dc-49d3-b204-90d6b34df076 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:28.887263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ed3a3-c5dc-49d3-b204-90d6b34df076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:28.936404 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4f2ed3a3-c5dc-49d3-b204-90d6b34df076 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:28.939280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4f2ed3a3-c5dc-49d3-b204-90d6b34df076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:28.997508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1145/2282] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:29.017834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.021701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:29.164938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1138/2283] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:29.176508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad979f3-08b9-42de-bf8c-287b98fea109 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.185523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d830-661d-4222-b18a-b83d6f3885ba None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.186737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d830-661d-4222-b18a-b83d6f3885ba None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.187340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908d830-661d-4222-b18a-b83d6f3885ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.187702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.188507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.188872 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.189963 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.207255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.210365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.242704 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1146/2284] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:29.284844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e908d830-661d-4222-b18a-b83d6f3885ba None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:29.287283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e908d830-661d-4222-b18a-b83d6f3885ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:29.341804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1139/2285] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:29.345019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.388750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458569d0-2f1e-4ff6-88ba-40258ff75c89 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.402285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.403670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.404362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.404843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.407922 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:29.408735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.413904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.450615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1147/2286] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:29.456429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d830-661d-4222-b18a-b83d6f3885ba None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.469886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908d830-661d-4222-b18a-b83d6f3885ba None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.478356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.478939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.479218 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.479495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.480456 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.483070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.543092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1140/2287] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:29 2021] POST /identity/v3/projects => generated 381 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:29.550015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.581684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89ca9-231e-4f99-950f-0816aeb53dfb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.681667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.682499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.683089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.684068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.684421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.687435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.725965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1148/2288] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:29 2021] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:29.727267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.746439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15406d-4310-475c-b981-fd7af081b235 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.756000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.756768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.757359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.758445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.760035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.764062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.793158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1141/2289] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:18:29.793837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.805698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae487-8312-4aaa-a8b2-490fb36377b3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.821155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.821898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.822183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.822475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.829346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.829346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.842274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1149/2290] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:29 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:18:29.848681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.868110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32bc6c-945d-415f-8bab-40a91042d689 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.877810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb856f99-10f6-4aa0-9497-58d6d7c5216f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.878905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856f99-10f6-4aa0-9497-58d6d7c5216f admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.879261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856f99-10f6-4aa0-9497-58d6d7c5216f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.879595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb856f99-10f6-4aa0-9497-58d6d7c5216f admin admin] PATH_INFO: `/v3/projects/66ac9d6bd78b4cf0b360cab7b5d9ec44/users/8b41ed9ba7cf479ea5327e465bd06e69/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.892223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:29.894181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:29.914460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb856f99-10f6-4aa0-9497-58d6d7c5216f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66ac9d6bd78b4cf0b360cab7b5d9ec44, user_id=8b41ed9ba7cf479ea5327e465bd06e69, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.917809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc50abd-1f54-4038-9201-c7fc10bd2619 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:29.918145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb856f99-10f6-4aa0-9497-58d6d7c5216f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.924844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:29.925993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.926543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.926888 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] PATH_INFO: `/v3/projects/a9f7131cbc7543f4b947ede2f88757b1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:29.929089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f7131cbc7543f4b947ede2f88757b1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:29.931395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:29.951323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1142/2291] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:29 2021] PUT /identity/v3/projects/66ac9d6bd78b4cf0b360cab7b5d9ec44/users/8b41ed9ba7cf479ea5327e465bd06e69/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:29.975842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:29.976601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:29.977141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:30.087462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] MFA Rules not processed for user `8b41ed9ba7cf479ea5327e465bd06e69`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:30.089976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:30.130351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f7131cbc7543f4b947ede2f88757b1', 'request_id': 'req-bceaebb5-3691-41cf-aae4-09e19575d056'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.147004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f7131cbc7543f4b947ede2f88757b1', 'request_id': 'req-bceaebb5-3691-41cf-aae4-09e19575d056'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.158230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f7131cbc7543f4b947ede2f88757b1', 'request_id': 'req-bceaebb5-3691-41cf-aae4-09e19575d056'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.185957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] The token cache is being invalidate because project a9f7131cbc7543f4b947ede2f88757b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:30.185957 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.187058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.202335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1150/2292] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:29 2021] DELETE /identity/v3/projects/a9f7131cbc7543f4b947ede2f88757b1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:30.206592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:30.208362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:30.258282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1143/2293] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:29 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:30.266140 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:30.268270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:30.386761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceaebb5-3691-41cf-aae4-09e19575d056 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:30.396705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:30.399261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:30.399846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:30.400657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] PATH_INFO: `/v3/users/988ad9b0813c4ef58460cccca71b4e50` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:30.403803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988ad9b0813c4ef58460cccca71b4e50)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:30.406128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:30.456525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edee3a7-8b12-4cc0-b560-d875be3da977 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:30.483515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:30.484909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:30.485601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:30.490930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:30.492151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:30.494920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:30.539081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988ad9b0813c4ef58460cccca71b4e50'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.541603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988ad9b0813c4ef58460cccca71b4e50'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.568733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988ad9b0813c4ef58460cccca71b4e50'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.571871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1144/2294] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:30 2021] POST /identity/v3/projects => generated 383 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:30.578962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:30.601077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988ad9b0813c4ef58460cccca71b4e50'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.616821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988ad9b0813c4ef58460cccca71b4e50'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:30.632077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1151/2295] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:30 2021] DELETE /identity/v3/users/988ad9b0813c4ef58460cccca71b4e50 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:30.732516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a338ca-5689-4f40-b51a-e8ae8a45d4c7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:30.867405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:30.867929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:30.868261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:30.868924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:30.869797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:30.872780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:30.909535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1145/2296] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:30 2021] POST /identity/v3/users => generated 298 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:18:30.914830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:30.916701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:30.944853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dbfee-d1fb-4b13-9d01-af9d19ee7556 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:30.956877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:30.958320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:30.959096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:30.959629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:30.961767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:30.970779 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:30.987372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1152/2297] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:30 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:30.994284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:31.027276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6b5ac-1bf2-463e-b8ab-6fb343f0c4d1 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:31.056449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:31.058056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.059660 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.060432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] PATH_INFO: `/v3/projects/45dedc1cc9ac42fc8bfaa94328e4803e/users/e504ecf9ab424ae6bd05593d677ade83/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.107210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dedc1cc9ac42fc8bfaa94328e4803e, user_id=e504ecf9ab424ae6bd05593d677ade83, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:31.110093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:31.132229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1146/2298] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:30 2021] PUT /identity/v3/projects/45dedc1cc9ac42fc8bfaa94328e4803e/users/e504ecf9ab424ae6bd05593d677ade83/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:31.136880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:31.149384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0a4aa-8a2e-4663-85a7-db8b28346d28 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:31.263378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bab3681-8a6c-4118-92ad-3bc38de38722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:31.264633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab3681-8a6c-4118-92ad-3bc38de38722 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.265478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab3681-8a6c-4118-92ad-3bc38de38722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.266749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bab3681-8a6c-4118-92ad-3bc38de38722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.267480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab3681-8a6c-4118-92ad-3bc38de38722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:31.270573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bab3681-8a6c-4118-92ad-3bc38de38722 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:31.298823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1153/2299] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:31.302159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:31.323376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e46c6-ea33-4bb1-8062-e64d8f184405 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:31.329177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38782d-656a-4291-8daa-98087b25ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:31.330340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38782d-656a-4291-8daa-98087b25ff98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.330545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38782d-656a-4291-8daa-98087b25ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.330696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38782d-656a-4291-8daa-98087b25ff98 admin admin] PATH_INFO: `/v3/projects/45dedc1cc9ac42fc8bfaa94328e4803e/users/e504ecf9ab424ae6bd05593d677ade83/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.333665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38782d-656a-4291-8daa-98087b25ff98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dedc1cc9ac42fc8bfaa94328e4803e, user_id=e504ecf9ab424ae6bd05593d677ade83, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:31.336365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38782d-656a-4291-8daa-98087b25ff98 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:31.364923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1147/2300] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:31 2021] PUT /identity/v3/projects/45dedc1cc9ac42fc8bfaa94328e4803e/users/e504ecf9ab424ae6bd05593d677ade83/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:31.367502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.367947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.368421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.419997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] MFA Rules not processed for user `e504ecf9ab424ae6bd05593d677ade83`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:31.422250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:31.474069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.474500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.474966 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.506996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] MFA Rules not processed for user `c8fe1f34da024d0b8151c6f6760504ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:31.509264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:31.592123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1154/2301] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:31 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:31.603483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:31.606384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:31.644243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1148/2302] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:31 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:31.690250 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:31.693702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:31.711380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3094594-0851-4ea9-8af7-9242658a9387 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:31.717939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:31.719151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.719746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.720185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.735508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:31.737771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:31.773927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1155/2303] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:31 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:18:31.831726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5432-b5ce-469b-8db7-6e7cc8ad8a07 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:31.838321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:31.840413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.840890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.841728 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] PATH_INFO: `/v3/projects/c3f8747888084908b728b006e520902e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.843155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f8747888084908b728b006e520902e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:31.845488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:31.871961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:31.884277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82c2b0-b77b-4596-84b9-41134c4ebb80 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:31.892747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88f156-4cbb-4df1-8234-8f347206919f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:31.893379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88f156-4cbb-4df1-8234-8f347206919f service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:31.893756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88f156-4cbb-4df1-8234-8f347206919f service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:31.894036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88f156-4cbb-4df1-8234-8f347206919f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:31.896190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6c88f156-4cbb-4df1-8234-8f347206919f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:31.958627 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f8747888084908b728b006e520902e', 'request_id': 'req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:31.972251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f8747888084908b728b006e520902e', 'request_id': 'req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:31.987058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f8747888084908b728b006e520902e', 'request_id': 'req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:31.991247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88f156-4cbb-4df1-8234-8f347206919f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:31.992901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88f156-4cbb-4df1-8234-8f347206919f service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:32.004698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] The token cache is being invalidate because project c3f8747888084908b728b006e520902e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:32.004979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:32.005727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:32.007352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1149/2304] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:31 2021] DELETE /identity/v3/projects/c3f8747888084908b728b006e520902e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:32.008463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1156/2305] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:31 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:32.389196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:32.390920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:32.480805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6fe1d-b90b-4143-9c54-9d8e7d98b051 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:32.494251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:32.496387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:32.496979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:32.497561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] PATH_INFO: `/v3/users/8b41ed9ba7cf479ea5327e465bd06e69` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:32.499580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b41ed9ba7cf479ea5327e465bd06e69)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:32.501751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:32.559834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b41ed9ba7cf479ea5327e465bd06e69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:32.560510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b41ed9ba7cf479ea5327e465bd06e69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:32.576273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b41ed9ba7cf479ea5327e465bd06e69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:32.604358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b41ed9ba7cf479ea5327e465bd06e69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:32.642875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b41ed9ba7cf479ea5327e465bd06e69'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:32.660266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1150/2306] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:32 2021] DELETE /identity/v3/users/8b41ed9ba7cf479ea5327e465bd06e69 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:32.662792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:32.663728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:32.664178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:32.687184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:32.688771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:32.812220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1157/2307] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:32.830967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:32.832432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:32.906804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eaf250-4804-49ff-96c5-881e8400aff3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:32.914146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:32.915585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:32.916062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:32.916403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:32.931464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:32.933463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:32.946654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1151/2308] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:33.380358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:33.382012 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:33.398901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f29fa0-b074-49e1-ac1b-4c64d4e8331e None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:33.406130 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:33.407230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:33.407555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:33.408019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] PATH_INFO: `/v3/projects/66ac9d6bd78b4cf0b360cab7b5d9ec44` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:33.410405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66ac9d6bd78b4cf0b360cab7b5d9ec44)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:33.412856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:33.493523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66ac9d6bd78b4cf0b360cab7b5d9ec44', 'request_id': 'req-620a5e61-3fdd-49d6-a725-69fcbd5ea134'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.501353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66ac9d6bd78b4cf0b360cab7b5d9ec44', 'request_id': 'req-620a5e61-3fdd-49d6-a725-69fcbd5ea134'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.510655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66ac9d6bd78b4cf0b360cab7b5d9ec44', 'request_id': 'req-620a5e61-3fdd-49d6-a725-69fcbd5ea134'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.530715 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] The token cache is being invalidate because project 66ac9d6bd78b4cf0b360cab7b5d9ec44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:33.530996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.531683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.533590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1158/2309] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:33 2021] DELETE /identity/v3/projects/66ac9d6bd78b4cf0b360cab7b5d9ec44 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:33.538587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:33.550193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc244a-789b-4e1d-8ff6-e13064f04689 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:33.623386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:33.624562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:33.624896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:33.625322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] PATH_INFO: `/v3/users/e504ecf9ab424ae6bd05593d677ade83` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:33.626922 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e504ecf9ab424ae6bd05593d677ade83)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:33.629534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:33.701234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e504ecf9ab424ae6bd05593d677ade83'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.701969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e504ecf9ab424ae6bd05593d677ade83'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.713292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e504ecf9ab424ae6bd05593d677ade83'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.740112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e504ecf9ab424ae6bd05593d677ade83'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.752762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c08a95e3-c5dd-41db-b008-32e9ce0401e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e504ecf9ab424ae6bd05593d677ade83'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:33.771064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1152/2310] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:33 2021] DELETE /identity/v3/users/e504ecf9ab424ae6bd05593d677ade83 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:34.233315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:34.235313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:34.263037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a5e61-3fdd-49d6-a725-69fcbd5ea134 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:34.375552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:34.377301 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:34.377923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:34.378386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] PATH_INFO: `/v3/projects/45dedc1cc9ac42fc8bfaa94328e4803e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:34.380791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45dedc1cc9ac42fc8bfaa94328e4803e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:34.384618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:34.467875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45dedc1cc9ac42fc8bfaa94328e4803e', 'request_id': 'req-f6396b7e-a364-4d69-bed4-c8220d0bdf68'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:34.480446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45dedc1cc9ac42fc8bfaa94328e4803e', 'request_id': 'req-f6396b7e-a364-4d69-bed4-c8220d0bdf68'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:34.490840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45dedc1cc9ac42fc8bfaa94328e4803e', 'request_id': 'req-f6396b7e-a364-4d69-bed4-c8220d0bdf68'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:34.509629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] The token cache is being invalidate because project 45dedc1cc9ac42fc8bfaa94328e4803e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:34.509953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:34.510646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f6396b7e-a364-4d69-bed4-c8220d0bdf68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:34.512420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1159/2311] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:34 2021] DELETE /identity/v3/projects/45dedc1cc9ac42fc8bfaa94328e4803e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:34.519457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f540-b6ac-48be-9ff5-46b22bd64740 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:34.519808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f540-b6ac-48be-9ff5-46b22bd64740 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:34.520154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f540-b6ac-48be-9ff5-46b22bd64740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:34.543588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-92c3f540-b6ac-48be-9ff5-46b22bd64740 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:34.544864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-92c3f540-b6ac-48be-9ff5-46b22bd64740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:34.624719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1153/2312] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:34.634884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dbe0a-2ecf-4d8d-9d5a-2417fc203878 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:34.635090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dbe0a-2ecf-4d8d-9d5a-2417fc203878 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:34.635310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dbe0a-2ecf-4d8d-9d5a-2417fc203878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:34.660425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-993dbe0a-2ecf-4d8d-9d5a-2417fc203878 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:34.661876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-993dbe0a-2ecf-4d8d-9d5a-2417fc203878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:34.670752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1160/2313] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:34.675787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3f540-b6ac-48be-9ff5-46b22bd64740 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:34.687672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3f540-b6ac-48be-9ff5-46b22bd64740 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:34.694249 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:34.695124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:34.695460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:34.695780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:34.696609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:34.696958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:34.698871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:34.712446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1154/2314] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:34.717204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dbe0a-2ecf-4d8d-9d5a-2417fc203878 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:34.727579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dbe0a-2ecf-4d8d-9d5a-2417fc203878 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:34.733264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:34.733984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:34.734263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:34.734534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:34.735273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:34.737190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:34.771626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1161/2315] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:34 2021] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:34.772808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:34.784801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4b6e70-515d-41c1-9600-69338ad1b3f3 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:34.910411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:34.911655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:34.912293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:34.912801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:34.914226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:34.918477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:34.956022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1155/2316] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:34 2021] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:18:34.960752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:34.985024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c8f82-20f0-4e08-b120-d9e865cb0e95 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:34.995846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:34.997694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:34.998442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:34.999068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:35.009786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:35.019717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:35.039537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1162/2317] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:34 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:35.044811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:35.061647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979fe22-5fa7-4e96-9a53-33e3d1f45361 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:35.069831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0f8a2-0847-4e92-8731-fece837fa7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:35.070939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f8a2-0847-4e92-8731-fece837fa7fc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:35.071403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f8a2-0847-4e92-8731-fece837fa7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:35.071803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f8a2-0847-4e92-8731-fece837fa7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:35.073159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0f8a2-0847-4e92-8731-fece837fa7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:35.075026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0f8a2-0847-4e92-8731-fece837fa7fc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:35.091800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1156/2318] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:35 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:35.096169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:35.110386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d3f84-9a74-4a62-a328-dc43006ef864 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:35.118494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:35.120009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:35.121202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:35.121728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] PATH_INFO: `/v3/projects/a5a179aaf0f641299382a1908d49dce7/users/4a496d779df344819a523f5779cad98d/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:35.164966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a179aaf0f641299382a1908d49dce7, user_id=4a496d779df344819a523f5779cad98d, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:35.169948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:35.203243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1163/2319] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:35 2021] PUT /identity/v3/projects/a5a179aaf0f641299382a1908d49dce7/users/4a496d779df344819a523f5779cad98d/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:35.222049 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4acf0-9322-4b0f-aa09-28321939b0be None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:35.223046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4acf0-9322-4b0f-aa09-28321939b0be None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:35.223506 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4acf0-9322-4b0f-aa09-28321939b0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:35.278000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f7e4acf0-9322-4b0f-aa09-28321939b0be None None] MFA Rules not processed for user `4a496d779df344819a523f5779cad98d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:35.280315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f7e4acf0-9322-4b0f-aa09-28321939b0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:35.413639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1157/2320] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:35.430562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:35.435064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:35.547429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7560-c6af-4dfd-9a1d-3e2977bbda02 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:35.551487 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:35.552157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:35.552446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:35.552720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:35.565722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:35.568507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:35.584582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1164/2321] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:35 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:18:42.251988 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e681921-b51f-4045-8f36-5f04e01e287c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:42.253612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e681921-b51f-4045-8f36-5f04e01e287c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:42.254334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e681921-b51f-4045-8f36-5f04e01e287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:42.285502 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3e681921-b51f-4045-8f36-5f04e01e287c None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:42.287663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3e681921-b51f-4045-8f36-5f04e01e287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:42.392743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1158/2322] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:18:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:42.438802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:42.440312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:42.522808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb8787-74c8-4bed-815f-d407f921f0f4 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:42.528931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:42.529655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:42.529933 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:42.530205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:42.540520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:42.542332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:42.551932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1165/2323] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:18:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:18:43.469122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2f98-88ca-4c07-b91f-4d6d6e73dcb6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:43.469727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2f98-88ca-4c07-b91f-4d6d6e73dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:43.470066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2f98-88ca-4c07-b91f-4d6d6e73dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:43.491261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b9fc2f98-88ca-4c07-b91f-4d6d6e73dcb6 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:43.492957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b9fc2f98-88ca-4c07-b91f-4d6d6e73dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:43.501656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1159/2324] 10.222.0.31 () {58 vars in 967 bytes} [Tue Nov 16 03:18:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:43.518875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:43.530427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd138f2a-1ed5-44f3-ace8-87076bae382a service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:43.537709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:43.537709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:43.537709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:43.538070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:43.547243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:43.549036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:43.558626 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1166/2325] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:18:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:18:43.884947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4b44-3441-48fc-a395-a3adad2f2a10 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:43.885463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4b44-3441-48fc-a395-a3adad2f2a10 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:43.885886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4b44-3441-48fc-a395-a3adad2f2a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:43.910993 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-621e4b44-3441-48fc-a395-a3adad2f2a10 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:43.912907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-621e4b44-3441-48fc-a395-a3adad2f2a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:43.935674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1160/2326] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:18:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:43.946516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:43.958071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c9961-2665-4133-8d9d-603789f7bbf4 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:43.964513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:43.965521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:43.965845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:43.966220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:43.977088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:43.979330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:43.989908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1167/2327] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:18:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:18:44.538942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:44.539515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:44.539643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:44.565796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:44.567108 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:44.575580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1161/2328] 10.222.0.31 () {58 vars in 967 bytes} [Tue Nov 16 03:18:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:44.591478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:44.604398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10dd8c-b3e9-4b66-a11d-74ca2a338832 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:44.611642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800c17c-a794-4dd3-9b08-eccbaad47db3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:44.612839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c17c-a794-4dd3-9b08-eccbaad47db3 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:44.613063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c17c-a794-4dd3-9b08-eccbaad47db3 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:44.613589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800c17c-a794-4dd3-9b08-eccbaad47db3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:44.627457 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800c17c-a794-4dd3-9b08-eccbaad47db3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:44.629462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800c17c-a794-4dd3-9b08-eccbaad47db3 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:44.639220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1168/2329] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:18:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:18:47.020396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:47.022159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:47.114177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a64b6b-76de-4cc8-964a-9cf0ebe65f1f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:47.119426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:47.120508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:47.120786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:47.121086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] PATH_INFO: `/v3/users/6dc7dece370545dcb785dc4ce56fc717` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:47.123058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dc7dece370545dcb785dc4ce56fc717)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:47.125189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:47.190509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dc7dece370545dcb785dc4ce56fc717'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.191236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dc7dece370545dcb785dc4ce56fc717'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.198673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dc7dece370545dcb785dc4ce56fc717'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.215475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dc7dece370545dcb785dc4ce56fc717'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.225081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dc7dece370545dcb785dc4ce56fc717'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.232837 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1162/2330] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:18:47 2021] DELETE /identity/v3/users/6dc7dece370545dcb785dc4ce56fc717 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:18:47.238023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:47.238728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:47.238728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:47.257949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:47.259180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:47.360094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1169/2331] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:47.374427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:47.375947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:47.440005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d2ea10-0205-4275-b18b-62c5b3708ec7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:47.444955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1265a-c057-4f5f-bea1-0f8d7a3104c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:47.446247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1265a-c057-4f5f-bea1-0f8d7a3104c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:47.446959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1265a-c057-4f5f-bea1-0f8d7a3104c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:47.447313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1265a-c057-4f5f-bea1-0f8d7a3104c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:47.466959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1265a-c057-4f5f-bea1-0f8d7a3104c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:47.468414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1265a-c057-4f5f-bea1-0f8d7a3104c2 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:47.492641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1163/2332] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:18:47.789905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:47.792232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:47.811456 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6315264-a4b2-47b7-9d3c-45abec6e07e8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:47.838329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:47.841275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:47.841835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:47.849625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] PATH_INFO: `/v3/projects/9dd17d33e39d4d719a978fe26d5ccb1d` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:47.853709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd17d33e39d4d719a978fe26d5ccb1d)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:47.856310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:47.937853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd17d33e39d4d719a978fe26d5ccb1d', 'request_id': 'req-7e4029f7-9dd2-4b82-a916-7b0e30672be2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.945172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd17d33e39d4d719a978fe26d5ccb1d', 'request_id': 'req-7e4029f7-9dd2-4b82-a916-7b0e30672be2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.954977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd17d33e39d4d719a978fe26d5ccb1d', 'request_id': 'req-7e4029f7-9dd2-4b82-a916-7b0e30672be2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.968602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] The token cache is being invalidate because project 9dd17d33e39d4d719a978fe26d5ccb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:18:47.968886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.969558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7e4029f7-9dd2-4b82-a916-7b0e30672be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:18:47.971173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1170/2333] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:18:47 2021] DELETE /identity/v3/projects/9dd17d33e39d4d719a978fe26d5ccb1d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:47.978243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afcd12-0b21-4cdc-8e66-6662681e0634 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:47.978525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afcd12-0b21-4cdc-8e66-6662681e0634 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:47.978800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afcd12-0b21-4cdc-8e66-6662681e0634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.001446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c3afcd12-0b21-4cdc-8e66-6662681e0634 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:48.003389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c3afcd12-0b21-4cdc-8e66-6662681e0634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:48.077445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1164/2334] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:48.086055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c603a-a857-4794-8f35-3cd55dc92307 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.086368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c603a-a857-4794-8f35-3cd55dc92307 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.086612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c603a-a857-4794-8f35-3cd55dc92307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.107424 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-555c603a-a857-4794-8f35-3cd55dc92307 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:48.108665 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-555c603a-a857-4794-8f35-3cd55dc92307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:48.117878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1171/2335] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:18:48.122923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afcd12-0b21-4cdc-8e66-6662681e0634 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:48.133771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afcd12-0b21-4cdc-8e66-6662681e0634 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:48.139058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:48.139634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.139916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.140223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.140958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:18:48.141257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:48.142901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:48.160768 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1165/2336] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:18:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:18:48.162082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c603a-a857-4794-8f35-3cd55dc92307 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:48.174151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c603a-a857-4794-8f35-3cd55dc92307 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:48.180148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:48.180841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.181284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.182066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.182971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:48.185405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:48.224266 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1172/2337] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:18:48 2021] POST /identity/v3/projects => generated 399 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:48.228714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:48.240678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef2fb0-0007-4cfc-a467-880c451d1d0a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:48.352166 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:48.353735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.355534 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.355951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.358205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:48.361367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:48.392300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1166/2338] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:18:48 2021] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:18:48.402357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:48.411653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbbd1a-b039-4120-a7a3-a45a8e69cf8f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:48.418606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:48.419452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.419811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.420685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.421504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:48.423447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:48.437472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1173/2339] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:48 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:48.442060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:48.454691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48562ae-bc5b-4791-98de-3bf7b5bc0bae admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:48.460297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac0098-cca9-4be9-a808-4b213f744cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:48.461215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0098-cca9-4be9-a808-4b213f744cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.461598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0098-cca9-4be9-a808-4b213f744cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.461884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac0098-cca9-4be9-a808-4b213f744cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.462898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac0098-cca9-4be9-a808-4b213f744cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:48.464644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bac0098-cca9-4be9-a808-4b213f744cc3 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:48.479269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1167/2340] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:18:48 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:18:48.484939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:48.499499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee8068-683e-4456-84fd-d5121253d3cf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:48.505669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:48.506690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.507048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.511892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] PATH_INFO: `/v3/projects/40e3b27937b94ecfac741effc17cc499/users/3e1b85d5d311476dabbf5138457d8f0e/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.543280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40e3b27937b94ecfac741effc17cc499, user_id=3e1b85d5d311476dabbf5138457d8f0e, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:48.546707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:48.567903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1174/2341] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:18:48 2021] PUT /identity/v3/projects/40e3b27937b94ecfac741effc17cc499/users/3e1b85d5d311476dabbf5138457d8f0e/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:18:48.580076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438c2d-0c73-4b6b-9def-778cc02e9cfd None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.580887 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438c2d-0c73-4b6b-9def-778cc02e9cfd None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.581412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79438c2d-0c73-4b6b-9def-778cc02e9cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.616009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-79438c2d-0c73-4b6b-9def-778cc02e9cfd None None] MFA Rules not processed for user `3e1b85d5d311476dabbf5138457d8f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:18:48.617665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-79438c2d-0c73-4b6b-9def-778cc02e9cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:48.706125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1168/2342] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:18:48 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:18:48.719868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:18:48.721794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:18:48.803200 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db56cff-abdd-42f9-abf8-634dd0cbbef3 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:18:48.814399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57955465-d3ce-436a-8c2c-3489d4380518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:18:48.815096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955465-d3ce-436a-8c2c-3489d4380518 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:18:48.815385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955465-d3ce-436a-8c2c-3489d4380518 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:18:48.815676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57955465-d3ce-436a-8c2c-3489d4380518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:18:48.829971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57955465-d3ce-436a-8c2c-3489d4380518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:18:48.832002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57955465-d3ce-436a-8c2c-3489d4380518 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:18:48.847723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1175/2343] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:18:48 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:01.935460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438c2d-0c73-4b6b-9def-778cc02e9cfd None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:02.031609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79438c2d-0c73-4b6b-9def-778cc02e9cfd None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:02.040949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:02.040949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:02.040949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:02.040949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] PATH_INFO: `/v3/users/3e1b85d5d311476dabbf5138457d8f0e` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:02.045131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1b85d5d311476dabbf5138457d8f0e)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:02.048197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:02.109228 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1b85d5d311476dabbf5138457d8f0e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.110111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1b85d5d311476dabbf5138457d8f0e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.117568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1b85d5d311476dabbf5138457d8f0e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.133131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1b85d5d311476dabbf5138457d8f0e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.143948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1b85d5d311476dabbf5138457d8f0e'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.151696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1169/2344] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:01 2021] DELETE /identity/v3/users/3e1b85d5d311476dabbf5138457d8f0e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:02.157090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:02.157643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:02.157643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:02.183396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:02.184706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:02.265227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1176/2345] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:02.279624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:02.281286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:02.358116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0f77a-3e39-4b87-bdce-294f15ade25a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:02.362190 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:02.362888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:02.363203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:02.363562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:02.374753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:02.376687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:02.389119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1170/2346] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:19:02.678298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:02.679843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:02.693901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f62ce-74d5-47f7-8964-3d789888c808 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:02.699830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:02.700386 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:02.700843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:02.701168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] PATH_INFO: `/v3/projects/40e3b27937b94ecfac741effc17cc499` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:02.702471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40e3b27937b94ecfac741effc17cc499)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:02.705319 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:02.765578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40e3b27937b94ecfac741effc17cc499', 'request_id': 'req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.772549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40e3b27937b94ecfac741effc17cc499', 'request_id': 'req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.779026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40e3b27937b94ecfac741effc17cc499', 'request_id': 'req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.792904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] The token cache is being invalidate because project 40e3b27937b94ecfac741effc17cc499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:02.793620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.793944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-15f07c00-89ec-4a9b-add5-8f6fbbcdd6c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:02.795512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1177/2347] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:02 2021] DELETE /identity/v3/projects/40e3b27937b94ecfac741effc17cc499 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:03.380600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:03.383208 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:03.405883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad52e5d-8ec0-4443-b766-bdda99b60e8e service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:03.481499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:03.482388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:03.482667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:03.482950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] PATH_INFO: `/v3/users/4a496d779df344819a523f5779cad98d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:03.484217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a496d779df344819a523f5779cad98d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:03.486221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:03.553411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a496d779df344819a523f5779cad98d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:03.554486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a496d779df344819a523f5779cad98d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:03.566881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a496d779df344819a523f5779cad98d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:03.585833 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a496d779df344819a523f5779cad98d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:03.599595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a496d779df344819a523f5779cad98d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:03.606547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1171/2348] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:03 2021] DELETE /identity/v3/users/4a496d779df344819a523f5779cad98d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:03.611901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:03.612427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:03.612427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:03.632920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:03.634297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:03.712284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1178/2349] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:03.723396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:03.725169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:03.812266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7bf39d-dcd7-4fc8-aca2-fda13b23a1ff admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:03.816485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101c9e9-c567-4762-9b7e-e40c862cc19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:03.817174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c9e9-c567-4762-9b7e-e40c862cc19f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:03.817481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c9e9-c567-4762-9b7e-e40c862cc19f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:03.817924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c9e9-c567-4762-9b7e-e40c862cc19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:03.828375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101c9e9-c567-4762-9b7e-e40c862cc19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:03.829912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101c9e9-c567-4762-9b7e-e40c862cc19f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:03.841937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1172/2350] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:04.159430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.161617 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:04.177150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b530c-6caf-4162-8354-e0e868361ddc None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:04.183604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:04.184711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.184997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.185540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] PATH_INFO: `/v3/projects/a5a179aaf0f641299382a1908d49dce7` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.186703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a179aaf0f641299382a1908d49dce7)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:04.188682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:04.238349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a179aaf0f641299382a1908d49dce7', 'request_id': 'req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:04.245002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a179aaf0f641299382a1908d49dce7', 'request_id': 'req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:04.251842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a179aaf0f641299382a1908d49dce7', 'request_id': 'req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:04.271673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] The token cache is being invalidate because project a5a179aaf0f641299382a1908d49dce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:04.272294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:04.273443 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-eb3a8994-cd28-4fcf-90ad-7fa1788c5a4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:04.281355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1179/2351] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:04 2021] DELETE /identity/v3/projects/a5a179aaf0f641299382a1908d49dce7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:04.284327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153f4ce-0393-4053-928a-2df3c481f6a2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.284575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153f4ce-0393-4053-928a-2df3c481f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.284875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153f4ce-0393-4053-928a-2df3c481f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.305455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c153f4ce-0393-4053-928a-2df3c481f6a2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:04.306733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c153f4ce-0393-4053-928a-2df3c481f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:04.387869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1173/2352] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:04.396818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048b81-cae5-4b96-be5b-214d302368f6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.397108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048b81-cae5-4b96-be5b-214d302368f6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.397447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02048b81-cae5-4b96-be5b-214d302368f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.425828 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-02048b81-cae5-4b96-be5b-214d302368f6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:04.427077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-02048b81-cae5-4b96-be5b-214d302368f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:04.435546 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1180/2353] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:04.440110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153f4ce-0393-4053-928a-2df3c481f6a2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.454620 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153f4ce-0393-4053-928a-2df3c481f6a2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:04.455788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:04.456465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.456744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.457022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.457812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:19:04.458158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:04.459781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:04.482387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1174/2354] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:19:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:19:04.487488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048b81-cae5-4b96-be5b-214d302368f6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.497380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02048b81-cae5-4b96-be5b-214d302368f6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:04.503620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:04.504262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.504560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.504818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.505628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:04.509036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:04.541269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1181/2355] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:04 2021] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:04.546171 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.557211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2613431-baf8-4b33-ae78-d9d6e544c3da admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:04.619925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:04.621005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.621738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.622038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.623168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:04.626529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:04.651785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1175/2356] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:04 2021] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:04.656531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.668845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9695847-0c11-4f8e-880e-f13bcce84b52 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:04.674479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:04.675171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.675401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.675687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.676441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:04.678181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:04.689771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1182/2357] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:04.694061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.705500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3437c71b-1c16-4243-b0ea-33661d1821c7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:04.711124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea02620-a076-4fd0-8164-bda785d2e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:04.711865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02620-a076-4fd0-8164-bda785d2e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.712105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02620-a076-4fd0-8164-bda785d2e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.712358 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea02620-a076-4fd0-8164-bda785d2e4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.713097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea02620-a076-4fd0-8164-bda785d2e4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:04.714920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea02620-a076-4fd0-8164-bda785d2e4cf admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:04.726518 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1176/2358] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:04.732333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.744111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cf323-cde9-4c18-9b32-bc636b02700f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:04.750392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:04.751441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.751886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.752409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] PATH_INFO: `/v3/projects/f81429c756654be2bc5a5f8c93220d88/users/df414fb8107f4f9eb04cff3f52b67e98/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.772083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81429c756654be2bc5a5f8c93220d88, user_id=df414fb8107f4f9eb04cff3f52b67e98, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:04.774823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:04.797003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1183/2359] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:04 2021] PUT /identity/v3/projects/f81429c756654be2bc5a5f8c93220d88/users/df414fb8107f4f9eb04cff3f52b67e98/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:19:04.807722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d22b-da65-4451-9617-c0e9667e6ae5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:04.808011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d22b-da65-4451-9617-c0e9667e6ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:04.808392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5d22b-da65-4451-9617-c0e9667e6ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:04.848139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7cd5d22b-da65-4451-9617-c0e9667e6ae5 None None] MFA Rules not processed for user `df414fb8107f4f9eb04cff3f52b67e98`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:04.849489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7cd5d22b-da65-4451-9617-c0e9667e6ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:04.935272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1177/2360] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:04 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:04.946703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:04.948990 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:05.019588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa928998-fc60-45ad-9e32-6f377d786ce9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:05.023989 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254d10b-806a-4a6b-b3e4-7746a8a4ed16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:05.024662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d10b-806a-4a6b-b3e4-7746a8a4ed16 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:05.024948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d10b-806a-4a6b-b3e4-7746a8a4ed16 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:05.025226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254d10b-806a-4a6b-b3e4-7746a8a4ed16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:05.035205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254d10b-806a-4a6b-b3e4-7746a8a4ed16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:05.036673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254d10b-806a-4a6b-b3e4-7746a8a4ed16 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:05.049459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1184/2361] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:04 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:17.047173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5d22b-da65-4451-9617-c0e9667e6ae5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:17.130535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5d22b-da65-4451-9617-c0e9667e6ae5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:17.137362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:17.138949 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:17.139440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:17.139931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] PATH_INFO: `/v3/users/df414fb8107f4f9eb04cff3f52b67e98` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:17.142696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=df414fb8107f4f9eb04cff3f52b67e98)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:17.146229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:17.199376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df414fb8107f4f9eb04cff3f52b67e98'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:17.200290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df414fb8107f4f9eb04cff3f52b67e98'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:17.214907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df414fb8107f4f9eb04cff3f52b67e98'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:17.227732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df414fb8107f4f9eb04cff3f52b67e98'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:17.238539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f7b39ec6-d14a-498e-9d9b-1a81b605a2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df414fb8107f4f9eb04cff3f52b67e98'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:17.246707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1178/2362] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:17 2021] DELETE /identity/v3/users/df414fb8107f4f9eb04cff3f52b67e98 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:17.251791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:17.252418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:17.252418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:17.274382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:17.277312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:17.314650 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:17.314909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:17.315260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:17.337339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:17.338586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:17.356097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1185/2363] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:17.367809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:17.369732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:17.409295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1179/2364] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:19:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:19:17.429367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:17.431384 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:17.452355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae0fea-a216-4cf0-ad6f-adb6c7afcfd4 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:17.460228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:17.461197 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:17.461470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:17.461755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:17.474668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:17.476430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:17.494305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1186/2365] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:19:17.528990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bd519-6e3b-419e-abc9-db3be5a19156 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:17.544682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7ed86-ba5e-4402-a156-c67cd3f54f63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:17.547339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ed86-ba5e-4402-a156-c67cd3f54f63 service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:17.547707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ed86-ba5e-4402-a156-c67cd3f54f63 service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:17.548088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7ed86-ba5e-4402-a156-c67cd3f54f63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:17.570729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7ed86-ba5e-4402-a156-c67cd3f54f63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:17.574171 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7ed86-ba5e-4402-a156-c67cd3f54f63 service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:17.588280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1180/2366] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:19:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:19:17.882446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:17.884180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:17.907410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096ebc7-b4df-494a-b891-3c9b92cd0542 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:17.913907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:17.914950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:17.915399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:17.915720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] PATH_INFO: `/v3/projects/f81429c756654be2bc5a5f8c93220d88` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:17.917157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81429c756654be2bc5a5f8c93220d88)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:17.919149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:17.970756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81429c756654be2bc5a5f8c93220d88', 'request_id': 'req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:17.977655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81429c756654be2bc5a5f8c93220d88', 'request_id': 'req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:17.986692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81429c756654be2bc5a5f8c93220d88', 'request_id': 'req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:18.003403 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] The token cache is being invalidate because project f81429c756654be2bc5a5f8c93220d88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:18.003900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:18.004472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-c3c8f444-ba19-4ab1-a8e7-da4af50f35c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:18.006684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1187/2367] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:17 2021] DELETE /identity/v3/projects/f81429c756654be2bc5a5f8c93220d88 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:18.013309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc2ba-ee58-432f-be7e-c728ea6a795a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.013873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc2ba-ee58-432f-be7e-c728ea6a795a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.014260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edc2ba-ee58-432f-be7e-c728ea6a795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.035572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-78edc2ba-ee58-432f-be7e-c728ea6a795a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:18.037181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-78edc2ba-ee58-432f-be7e-c728ea6a795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:18.109698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1181/2368] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:18.118141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1b7a4-96f2-49f7-a2da-cc2304a13c3f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.118337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1b7a4-96f2-49f7-a2da-cc2304a13c3f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.118647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1b7a4-96f2-49f7-a2da-cc2304a13c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.138472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0eb1b7a4-96f2-49f7-a2da-cc2304a13c3f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:18.139669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0eb1b7a4-96f2-49f7-a2da-cc2304a13c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:18.148240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1188/2369] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:19:18.159654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc2ba-ee58-432f-be7e-c728ea6a795a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.170485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edc2ba-ee58-432f-be7e-c728ea6a795a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:18.177114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:18.178474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.179235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.179875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.182062 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:19:18.182846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:18.186081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:18.209560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1182/2370] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:19:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:19:18.213401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1b7a4-96f2-49f7-a2da-cc2304a13c3f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.228379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1b7a4-96f2-49f7-a2da-cc2304a13c3f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:18.233174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:18.233881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.234163 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.234479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.235169 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:18.237213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:18.284392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1189/2371] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:18.285798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.297714 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e83e1-13c8-4f57-9474-2704a22ca569 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:18.367666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:18.368599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.369223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.369528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.370270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:18.372209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:18.404398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.411100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1183/2372] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:19:18.417857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243051c-964a-48a9-a851-dd5bc276805a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:18.424036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:18.424820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.425105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.425382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.426557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:18.428345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:18.457843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.458214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1190/2373] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:18 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:19:18.471444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841f3ea-bd04-4313-854d-66e87615c147 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:18.488646 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4ee5c-88e8-48ce-b136-5e9af7eab8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:18.489403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ee5c-88e8-48ce-b136-5e9af7eab8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.489736 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ee5c-88e8-48ce-b136-5e9af7eab8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.490007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4ee5c-88e8-48ce-b136-5e9af7eab8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.490779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4ee5c-88e8-48ce-b136-5e9af7eab8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:18.492513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4ee5c-88e8-48ce-b136-5e9af7eab8a8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:18.504756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1184/2374] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:18 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:18.508909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.522209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54c044-f2f8-4894-86dc-faa8dcb8b98f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:18.528622 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6b00c-9b5d-4966-aa23-0c4b21189fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:18.529730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b00c-9b5d-4966-aa23-0c4b21189fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.530262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b00c-9b5d-4966-aa23-0c4b21189fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.530499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6b00c-9b5d-4966-aa23-0c4b21189fb1 admin admin] PATH_INFO: `/v3/projects/5bb8c5735db54f4ba6f49b7c225e7b49/users/22346202deb94909bb806a524d8130a5/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.577159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6b00c-9b5d-4966-aa23-0c4b21189fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb8c5735db54f4ba6f49b7c225e7b49, user_id=22346202deb94909bb806a524d8130a5, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:18.584231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6b00c-9b5d-4966-aa23-0c4b21189fb1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:18.618758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1191/2375] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:18 2021] PUT /identity/v3/projects/5bb8c5735db54f4ba6f49b7c225e7b49/users/22346202deb94909bb806a524d8130a5/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:18.630405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50db6-4f44-4ad8-8064-15612072c0f4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.630692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50db6-4f44-4ad8-8064-15612072c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.631010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50db6-4f44-4ad8-8064-15612072c0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.717743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-84f50db6-4f44-4ad8-8064-15612072c0f4 None None] MFA Rules not processed for user `22346202deb94909bb806a524d8130a5`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:18.719107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-84f50db6-4f44-4ad8-8064-15612072c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:18.789917 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29716eb-e4da-4083-9094-6039c44c4e9b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.790432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29716eb-e4da-4083-9094-6039c44c4e9b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.790918 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29716eb-e4da-4083-9094-6039c44c4e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.821713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d29716eb-e4da-4083-9094-6039c44c4e9b None None] MFA Rules not processed for user `681c813529d941f688bff8333ad3b089`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:18.823642 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d29716eb-e4da-4083-9094-6039c44c4e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:18.824138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1185/2376] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:18.833307 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f50db6-4f44-4ad8-8064-15612072c0f4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.900175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1192/2377] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:19:18.906660 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f50db6-4f44-4ad8-8064-15612072c0f4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:18.925820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:18.927263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:18.927263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:18.927263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:18.927854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:18.929836 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:18.967713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1186/2378] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:18.968891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29716eb-e4da-4083-9094-6039c44c4e9b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:18.989155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29716eb-e4da-4083-9094-6039c44c4e9b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.054859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.055800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.056239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.056507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.057240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.059238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.090905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1193/2379] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:18 2021] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:19.094511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:19.106721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1759f02-76ab-491c-aa36-ddb4db216303 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.111623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.112364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.112578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.112934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.113725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.115362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.126982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1187/2380] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:19 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:19.131171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:19.143027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67719f0d-09bd-46f0-887e-6e9535bd07cd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.156455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9fdcf-edaf-4686-85bb-f8711a5bfb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.157254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9fdcf-edaf-4686-85bb-f8711a5bfb7d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.157654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9fdcf-edaf-4686-85bb-f8711a5bfb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.157941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9fdcf-edaf-4686-85bb-f8711a5bfb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.159227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9fdcf-edaf-4686-85bb-f8711a5bfb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.160964 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9fdcf-edaf-4686-85bb-f8711a5bfb7d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.171965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1194/2381] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:19 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:19.177119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:19.189417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81145d-4cca-4c41-9b28-e920a0897cd7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.194348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.195659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.195868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.196177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] PATH_INFO: `/v3/projects/479c1573f4974a1aa44edba3757ca7a3/users/9335968c1f9e49efb24da412e3f61bef/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.219376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=479c1573f4974a1aa44edba3757ca7a3, user_id=9335968c1f9e49efb24da412e3f61bef, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.222920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.248287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1188/2382] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:19 2021] PUT /identity/v3/projects/479c1573f4974a1aa44edba3757ca7a3/users/9335968c1f9e49efb24da412e3f61bef/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:19.259701 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e991e8-7428-4959-8083-3e5e29e4158d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.260146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e991e8-7428-4959-8083-3e5e29e4158d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.260486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e991e8-7428-4959-8083-3e5e29e4158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.291572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-89e991e8-7428-4959-8083-3e5e29e4158d None None] MFA Rules not processed for user `9335968c1f9e49efb24da412e3f61bef`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:19.292859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-89e991e8-7428-4959-8083-3e5e29e4158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:19.366311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1195/2383] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:19 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:19.372174 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:19.484903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa5876-87e2-46a2-a5a9-d5b173d6ab0c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.490199 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.490873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.491152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.491427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.492152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.494132 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.524564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1189/2384] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:19 2021] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:19.528988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e991e8-7428-4959-8083-3e5e29e4158d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:19.541650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e991e8-7428-4959-8083-3e5e29e4158d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.613697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.614398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.614680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.614955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.615675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.617675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.646066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1196/2385] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:19 2021] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:19.650114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:19.667159 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd4e2a-968a-4a6b-9c06-d90a19c479ca admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.682279 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.683380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.683934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.684203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.685200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.687153 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.722722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1190/2386] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:19 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:19:19.727506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:19.750248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260841c-e9d0-4fc7-98bd-813f90778c88 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:19.763812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:19.765520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:19.765908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:19.766194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] PATH_INFO: `/v3/projects/c98fbfa10a2c44b3a7b9c48a7cd15540/users/bd48a014f29546d99de5294c27f82799/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:19.802725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98fbfa10a2c44b3a7b9c48a7cd15540, user_id=bd48a014f29546d99de5294c27f82799, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:19.821297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:19.915914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1197/2387] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:19 2021] PUT /identity/v3/projects/c98fbfa10a2c44b3a7b9c48a7cd15540/users/bd48a014f29546d99de5294c27f82799/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:19.922315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:20.017897 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bb8a8-fa08-4f56-85dc-8ae13927ba84 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:20.162414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e7506-9c90-4118-ab45-c2631e807aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:20.164842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e7506-9c90-4118-ab45-c2631e807aee admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:20.165329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e7506-9c90-4118-ab45-c2631e807aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:20.165860 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e7506-9c90-4118-ab45-c2631e807aee admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:20.167695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e7506-9c90-4118-ab45-c2631e807aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:20.172173 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e7506-9c90-4118-ab45-c2631e807aee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:20.205222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:20.214515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1191/2388] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:19 2021] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:20.288351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53f293-464f-4066-a3fb-2e15107f592a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:20.293694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:20.294609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:20.295281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:20.295732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] PATH_INFO: `/v3/projects/c98fbfa10a2c44b3a7b9c48a7cd15540/users/bd48a014f29546d99de5294c27f82799/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:20.298422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98fbfa10a2c44b3a7b9c48a7cd15540, user_id=bd48a014f29546d99de5294c27f82799, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:20.307761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:20.339504 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1198/2389] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:20 2021] PUT /identity/v3/projects/c98fbfa10a2c44b3a7b9c48a7cd15540/users/bd48a014f29546d99de5294c27f82799/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:20.343889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9306-8dfd-43a6-a414-c986273e99df None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:20.345267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9306-8dfd-43a6-a414-c986273e99df None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:20.346130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba9306-8dfd-43a6-a414-c986273e99df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:20.458839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c1ba9306-8dfd-43a6-a414-c986273e99df None None] MFA Rules not processed for user `bd48a014f29546d99de5294c27f82799`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:20.460103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1ba9306-8dfd-43a6-a414-c986273e99df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:20.645488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1192/2390] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:20 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:20.668345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:20.672743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:20.854571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1370b-cecf-4ac0-a1e9-f0d6339cf5e6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:20.858468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:20.859133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:20.859413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:20.859863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:20.946521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:20.949185 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:20.981563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1199/2391] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:20 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:27.033118 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9306-8dfd-43a6-a414-c986273e99df None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:27.046886 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba9306-8dfd-43a6-a414-c986273e99df None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:27.059639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:27.067560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:27.068811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:27.069712 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:27.226393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:27.227791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:27.241508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1193/2392] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:27 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:28.599430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:28.609907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4a7f9-ec2c-4f29-9910-0cbe6250ebe5 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:28.615777 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd73e87-446c-42a7-8132-e1a5b2896f87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:28.617651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73e87-446c-42a7-8132-e1a5b2896f87 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:28.618018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73e87-446c-42a7-8132-e1a5b2896f87 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:28.618389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73e87-446c-42a7-8132-e1a5b2896f87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:28.630691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73e87-446c-42a7-8132-e1a5b2896f87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:28.632471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73e87-446c-42a7-8132-e1a5b2896f87 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:28.649909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1200/2393] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:28 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:31.889493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:31.896414 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:31.988657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27978433-fb29-4d5a-8089-1493260bd110 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:32.004029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:32.005676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:32.006215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:32.006956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] PATH_INFO: `/v3/users/b8a4c5d6c134466d87ac2a2781ba8aaf` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:32.010603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a4c5d6c134466d87ac2a2781ba8aaf)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:32.013533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:32.157745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a4c5d6c134466d87ac2a2781ba8aaf'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.159235 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a4c5d6c134466d87ac2a2781ba8aaf'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.177905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a4c5d6c134466d87ac2a2781ba8aaf'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.199238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a4c5d6c134466d87ac2a2781ba8aaf'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.213834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a4c5d6c134466d87ac2a2781ba8aaf'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.228548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1194/2394] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:31 2021] DELETE /identity/v3/users/b8a4c5d6c134466d87ac2a2781ba8aaf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:32.233627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:32.234183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:32.234183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:32.271770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:32.273625 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:32.365575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1201/2395] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:32.376380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:32.378042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:32.515960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658412a6-489d-411b-a5bb-7eebedae579f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:32.525005 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae0331-0e50-4579-955e-2b4400d9121c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:32.526029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0331-0e50-4579-955e-2b4400d9121c service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:32.526319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0331-0e50-4579-955e-2b4400d9121c service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:32.526637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae0331-0e50-4579-955e-2b4400d9121c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:32.539192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae0331-0e50-4579-955e-2b4400d9121c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:32.540895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae0331-0e50-4579-955e-2b4400d9121c service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:32.553965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1195/2396] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:32.751649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:32.756111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:32.784969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e657a7-5d12-4763-8161-763170e68ad1 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:32.799349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:32.802257 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:32.802670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:32.803339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] PATH_INFO: `/v3/users/22346202deb94909bb806a524d8130a5` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:32.805550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22346202deb94909bb806a524d8130a5)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:32.807646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:32.902662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22346202deb94909bb806a524d8130a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.904684 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22346202deb94909bb806a524d8130a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.931605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22346202deb94909bb806a524d8130a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.963352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22346202deb94909bb806a524d8130a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:32.982894 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22346202deb94909bb806a524d8130a5'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.008526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1202/2397] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:32 2021] DELETE /identity/v3/users/22346202deb94909bb806a524d8130a5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:33.015823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.016495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.017027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.024522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:33.027723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.067034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:33.069207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.194567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0da4-702e-47d5-9bb8-ecb9790ce265 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:33.210607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:33.212758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.213232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.213982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] PATH_INFO: `/v3/projects/ec4cb4cfc9594548a3e294dc342b8542` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.216206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec4cb4cfc9594548a3e294dc342b8542)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:33.220138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:33.233598 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1196/2398] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:33.241255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:33.243954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.269470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d165a-9bec-4bd4-8798-abfc6242a88c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:33.280466 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:33.285715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.286365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.286865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] PATH_INFO: `/v3/users/8a9ecde3498b481ebdb498616477489a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.300311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a9ecde3498b481ebdb498616477489a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:33.306019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:33.306307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec4cb4cfc9594548a3e294dc342b8542', 'request_id': 'req-11d11f8b-63bb-4f41-ab36-6d930305539a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.315036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec4cb4cfc9594548a3e294dc342b8542', 'request_id': 'req-11d11f8b-63bb-4f41-ab36-6d930305539a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.332005 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec4cb4cfc9594548a3e294dc342b8542', 'request_id': 'req-11d11f8b-63bb-4f41-ab36-6d930305539a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.356236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] The token cache is being invalidate because project ec4cb4cfc9594548a3e294dc342b8542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:33.356583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.358523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.364186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1203/2399] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:33 2021] DELETE /identity/v3/projects/ec4cb4cfc9594548a3e294dc342b8542 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:19:33.364186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:33.370423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.420026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a9ecde3498b481ebdb498616477489a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.421787 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a9ecde3498b481ebdb498616477489a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.430043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a9ecde3498b481ebdb498616477489a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.452826 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a9ecde3498b481ebdb498616477489a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.464280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-fd819d9d-eb24-4210-9eb3-e68274c73ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a9ecde3498b481ebdb498616477489a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:33.478254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1197/2400] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:33 2021] DELETE /identity/v3/users/8a9ecde3498b481ebdb498616477489a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:33.478254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57394cb-e453-494a-9725-c7561e4ce807 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.478254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57394cb-e453-494a-9725-c7561e4ce807 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.478254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57394cb-e453-494a-9725-c7561e4ce807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.501861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d11f8b-63bb-4f41-ab36-6d930305539a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:33.518654 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e57394cb-e453-494a-9725-c7561e4ce807 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:33.519895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e57394cb-e453-494a-9725-c7561e4ce807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.624871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1198/2401] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:33.626432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f324b-5ad7-48fb-8dc0-500a8ca8d429 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.626906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f324b-5ad7-48fb-8dc0-500a8ca8d429 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.627282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f324b-5ad7-48fb-8dc0-500a8ca8d429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.634203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:33.634900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.635181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.635459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.637795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.650948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-376f324b-5ad7-48fb-8dc0-500a8ca8d429 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:33.652347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-376f324b-5ad7-48fb-8dc0-500a8ca8d429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.654497 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:33.656445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:33.661962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1199/2402] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:33.663560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac21a-89a7-43d5-8ea3-4f5f22cef7ed None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.663952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac21a-89a7-43d5-8ea3-4f5f22cef7ed None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.664366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcac21a-89a7-43d5-8ea3-4f5f22cef7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.670078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1204/2403] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:33.674498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:33.676432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.702468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580c200-c6a3-4a9a-95d4-429abc96359a service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:33.703747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ddcac21a-89a7-43d5-8ea3-4f5f22cef7ed None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:33.710087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:33.710962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ddcac21a-89a7-43d5-8ea3-4f5f22cef7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:33.711458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.711999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.712459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.730696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:33.732246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1200/2404] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:33.737656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcac21a-89a7-43d5-8ea3-4f5f22cef7ed None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:33.739809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:33.757326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcac21a-89a7-43d5-8ea3-4f5f22cef7ed None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:33.763827 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1205/2405] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:19:33.772079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:33.773354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.773354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.773354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.775772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:19:33.775772 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:33.777054 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:33.799537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:33.809551 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1201/2406] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:19:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 16 03:19:33.815238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddae07-4481-4a11-8933-ab7dfb6fa531 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:33.824334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:33.825004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:33.825362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:33.825742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:33.826558 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:33.828731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:33.886998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1206/2407] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:33 2021] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:33.892738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:33.919711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e63eb-6752-4c13-8607-ed1ebebc7db9 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:34.101151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:34.101151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.101151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.101151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.103115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:34.114370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:34.182663 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1202/2408] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:33 2021] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:34.186091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:34.223508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62d6f4-adcc-454f-90c0-4df5720428a8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:34.235855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:34.236542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.236825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.237101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.237884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:34.240044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:34.256664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1207/2409] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:34 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:34.258696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:34.284030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d7cf31-ffbb-4d8a-866a-49c61fd7afaa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:34.299087 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:34.299941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.300523 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.302575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.303935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:34.308612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:34.343198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1203/2410] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:34 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:34.349211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:34.363115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117eabf-5466-443d-89f9-3a4ae7f57162 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:34.383100 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:34.384164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.384505 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.384847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] PATH_INFO: `/v3/projects/f0e656658949487fb898565d34636908/users/d83e82f8ae2e4203b5f0c5d120c58792/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.424362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:34.426444 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:34.477747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e656658949487fb898565d34636908, user_id=d83e82f8ae2e4203b5f0c5d120c58792, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:34.481799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c683971-406e-4f73-b48e-00d7bd63f194 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:34.487498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:34.501832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:34.504106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.504400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.504849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] PATH_INFO: `/v3/projects/5bb8c5735db54f4ba6f49b7c225e7b49` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.510257 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb8c5735db54f4ba6f49b7c225e7b49)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:34.512227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:34.521934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1208/2411] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:34 2021] PUT /identity/v3/projects/f0e656658949487fb898565d34636908/users/d83e82f8ae2e4203b5f0c5d120c58792/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:34.534118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:34.537657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:34.639008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb8c5735db54f4ba6f49b7c225e7b49', 'request_id': 'req-39a73163-99d0-44df-b082-65b314b5b41c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:34.655502 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb8c5735db54f4ba6f49b7c225e7b49', 'request_id': 'req-39a73163-99d0-44df-b082-65b314b5b41c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:34.670823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb8c5735db54f4ba6f49b7c225e7b49', 'request_id': 'req-39a73163-99d0-44df-b082-65b314b5b41c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:34.684153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7485f-2adc-400e-83d2-119eec797d95 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:34.694292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] The token cache is being invalidate because project 5bb8c5735db54f4ba6f49b7c225e7b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:34.695026 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:34.695941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-39a73163-99d0-44df-b082-65b314b5b41c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:34.701182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1204/2412] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:34 2021] DELETE /identity/v3/projects/5bb8c5735db54f4ba6f49b7c225e7b49 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:19:34.706521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.709283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.710400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.744909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:34.746470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:34.846965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1205/2413] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:34.850364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:34.852175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:34.853182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:34.854116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.854397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.854673 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] PATH_INFO: `/v3/projects/5e6ca957daf741999d61ce3fd1099b9b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.857680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e6ca957daf741999d61ce3fd1099b9b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:34.861664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:34.884037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32de58-dee7-4b27-bb5c-43db170d9620 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:34.896959 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:34.899830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:34.901110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:34.901989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] PATH_INFO: `/v3/users/9335968c1f9e49efb24da412e3f61bef` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:34.906004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9335968c1f9e49efb24da412e3f61bef)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:34.910443 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.002022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e6ca957daf741999d61ce3fd1099b9b', 'request_id': 'req-478965ce-c264-4f8d-8375-b2d4fa985685'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.012943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e6ca957daf741999d61ce3fd1099b9b', 'request_id': 'req-478965ce-c264-4f8d-8375-b2d4fa985685'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.022030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e6ca957daf741999d61ce3fd1099b9b', 'request_id': 'req-478965ce-c264-4f8d-8375-b2d4fa985685'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.040782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9335968c1f9e49efb24da412e3f61bef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.041795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9335968c1f9e49efb24da412e3f61bef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.046045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] The token cache is being invalidate because project 5e6ca957daf741999d61ce3fd1099b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:35.046970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.048404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.050774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1209/2414] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:34 2021] DELETE /identity/v3/projects/5e6ca957daf741999d61ce3fd1099b9b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:35.052276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:35.054354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:35.063951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9335968c1f9e49efb24da412e3f61bef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.095486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9335968c1f9e49efb24da412e3f61bef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.108136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-76cc9b6e-2dc5-4a1f-93bc-25450fdbe3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9335968c1f9e49efb24da412e3f61bef'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:35.121838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1206/2415] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:34 2021] DELETE /identity/v3/users/9335968c1f9e49efb24da412e3f61bef => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:35.121838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6941a0-a40d-4401-a0e9-b7bdaf4c67c2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.121838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6941a0-a40d-4401-a0e9-b7bdaf4c67c2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.121838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6941a0-a40d-4401-a0e9-b7bdaf4c67c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.153806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2c6941a0-a40d-4401-a0e9-b7bdaf4c67c2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:35.156678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2c6941a0-a40d-4401-a0e9-b7bdaf4c67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:35.176408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478965ce-c264-4f8d-8375-b2d4fa985685 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:35.281389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:35.282450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.282758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.283104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.288149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:35.312119 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1207/2416] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:35.324507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ed137-5eb0-41db-abe3-5c6bef163abc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.325008 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ed137-5eb0-41db-abe3-5c6bef163abc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.325568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ed137-5eb0-41db-abe3-5c6bef163abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.376778 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-294ed137-5eb0-41db-abe3-5c6bef163abc None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:35.383278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-294ed137-5eb0-41db-abe3-5c6bef163abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:35.399491 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:35.402490 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.410150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1208/2417] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:35.416135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ed137-5eb0-41db-abe3-5c6bef163abc None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:35.436720 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ed137-5eb0-41db-abe3-5c6bef163abc None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:35.447126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:35.448495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.449071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.449724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.450094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1210/2418] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:35.451763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:19:35.452374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:35.456124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.493913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1209/2419] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:19:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:19:35.499935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:35.529378 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a19916-3bf7-4662-8baf-62513e83dfd8 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:35.537037 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:35.537959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.538344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.538716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.540320 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:35.543787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.622755 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1211/2420] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:35 2021] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:35.627486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:35.641278 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb42ba-c3cd-4d1d-8ee4-94116639c2dd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:35.762841 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:35.763545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.763871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.764137 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.764935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:35.767418 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.792989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1210/2421] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:35 2021] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:35.801228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:35.819588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a32ca-ce4c-4b0d-a4ad-bc0542561279 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:35.833085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:35.833942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.834249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.834614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.835446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:35.839805 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.865681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1212/2422] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:35 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:35.869950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:35.899152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93045a20-f12a-4ac0-bfb6-eea68dea71f7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:35.914602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:35.916727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:35.928288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:35.929876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.930501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.931852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.933287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:35.936668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.943447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d094bd-3e86-4f2d-92a7-088d61eeb8bb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:35.954248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:35.959560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:35.960578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:35.961254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] PATH_INFO: `/v3/projects/479c1573f4974a1aa44edba3757ca7a3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:35.964765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=479c1573f4974a1aa44edba3757ca7a3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:35.969061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:35.988761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1211/2423] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:35 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:35.990603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:36.011029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca109c9-624e-4fee-93dc-7e68fe0ab1dc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:36.027156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b90d8-8726-49e2-a7ac-83948c1e4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:36.029652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b90d8-8726-49e2-a7ac-83948c1e4cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:36.036411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b90d8-8726-49e2-a7ac-83948c1e4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:36.037213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b90d8-8726-49e2-a7ac-83948c1e4cf7 admin admin] PATH_INFO: `/v3/projects/b2e2d087909448898eb62ca5b6aae29a/users/435d729ade12442c9ea4d29558deaebe/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:36.085807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b90d8-8726-49e2-a7ac-83948c1e4cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e2d087909448898eb62ca5b6aae29a, user_id=435d729ade12442c9ea4d29558deaebe, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:36.096685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b90d8-8726-49e2-a7ac-83948c1e4cf7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:36.143734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1212/2424] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:35 2021] PUT /identity/v3/projects/b2e2d087909448898eb62ca5b6aae29a/users/435d729ade12442c9ea4d29558deaebe/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:36.165693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:36.166585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:36.167146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:36.224068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479c1573f4974a1aa44edba3757ca7a3', 'request_id': 'req-ddc30467-fb6a-4906-bd43-82786d3ab0b9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.239239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479c1573f4974a1aa44edba3757ca7a3', 'request_id': 'req-ddc30467-fb6a-4906-bd43-82786d3ab0b9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.246808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] MFA Rules not processed for user `435d729ade12442c9ea4d29558deaebe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:36.252076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:36.255144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479c1573f4974a1aa44edba3757ca7a3', 'request_id': 'req-ddc30467-fb6a-4906-bd43-82786d3ab0b9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.280803 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] The token cache is being invalidate because project 479c1573f4974a1aa44edba3757ca7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:36.283446 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.285698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.290585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1213/2425] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:35 2021] DELETE /identity/v3/projects/479c1573f4974a1aa44edba3757ca7a3 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:19:36.294454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:36.299109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:36.379106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1213/2426] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:36 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:36.395680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:36.397548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:36.470851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc30467-fb6a-4906-bd43-82786d3ab0b9 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:36.489655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:36.491015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:36.491557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:36.492028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] PATH_INFO: `/v3/users/bd48a014f29546d99de5294c27f82799` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:36.493758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd48a014f29546d99de5294c27f82799)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:36.500830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:36.539920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd660585-7723-4f6c-be39-a0cf1ec7634b None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:36.551361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:36.552834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:36.553286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:36.553761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:36.576338 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:36.580023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:36.597296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1214/2427] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:36 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:19:36.666664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd48a014f29546d99de5294c27f82799'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.668419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd48a014f29546d99de5294c27f82799'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.677961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd48a014f29546d99de5294c27f82799'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.690988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd48a014f29546d99de5294c27f82799'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.707494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b7b9314d-77ee-450d-9cf8-001101329049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd48a014f29546d99de5294c27f82799'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:36.715681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1214/2428] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:36 2021] DELETE /identity/v3/users/bd48a014f29546d99de5294c27f82799 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:19:37.346871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:37.376031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1f79-3499-472d-9b43-33ed86af829e service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:37.446506 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:37.447700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:37.448151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:37.448593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] PATH_INFO: `/v3/projects/c98fbfa10a2c44b3a7b9c48a7cd15540` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:37.450128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98fbfa10a2c44b3a7b9c48a7cd15540)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:37.452478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:37.584287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98fbfa10a2c44b3a7b9c48a7cd15540', 'request_id': 'req-6901e93b-f687-4d4e-87f6-9387f04da969'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:37.602365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98fbfa10a2c44b3a7b9c48a7cd15540', 'request_id': 'req-6901e93b-f687-4d4e-87f6-9387f04da969'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:37.617468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98fbfa10a2c44b3a7b9c48a7cd15540', 'request_id': 'req-6901e93b-f687-4d4e-87f6-9387f04da969'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:37.649937 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] The token cache is being invalidate because project c98fbfa10a2c44b3a7b9c48a7cd15540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:19:37.650303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:37.655147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-6901e93b-f687-4d4e-87f6-9387f04da969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:37.660616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1215/2429] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:19:37 2021] DELETE /identity/v3/projects/c98fbfa10a2c44b3a7b9c48a7cd15540 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:37.668171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c1bf-c009-4fd2-a3eb-47dc5e521513 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:37.668849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c1bf-c009-4fd2-a3eb-47dc5e521513 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:37.668849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1c1bf-c009-4fd2-a3eb-47dc5e521513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:37.748651 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-55f1c1bf-c009-4fd2-a3eb-47dc5e521513 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:37.751667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-55f1c1bf-c009-4fd2-a3eb-47dc5e521513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:38.046686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1215/2430] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:38.057309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7c249-9e6e-4b97-ae02-bf6808a14d7a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.057784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7c249-9e6e-4b97-ae02-bf6808a14d7a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.058361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c7c249-9e6e-4b97-ae02-bf6808a14d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.120611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-37c7c249-9e6e-4b97-ae02-bf6808a14d7a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:38.123290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-37c7c249-9e6e-4b97-ae02-bf6808a14d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:38.144160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1216/2431] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:38.148421 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c1bf-c009-4fd2-a3eb-47dc5e521513 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:38.161194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1c1bf-c009-4fd2-a3eb-47dc5e521513 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:38.179874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:38.180699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.180979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.181268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.182050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:19:38.182358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:38.184030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:38.219181 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1216/2432] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:19:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:19:38.224676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7c249-9e6e-4b97-ae02-bf6808a14d7a None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:38.240000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c7c249-9e6e-4b97-ae02-bf6808a14d7a None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:38.251215 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:38.251914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.252195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.252470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.253343 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:38.269743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:38.340829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1217/2433] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:38 2021] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:38.347273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:38.376209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06322-20a2-480e-9dd8-db1edcfcb3ba admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:38.555628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:38.556348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.556628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.556909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.568577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:38.573250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:38.633049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1217/2434] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:38 2021] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:19:38.638532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:38.663887 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182ff7-3a98-496b-a7c6-7b2f15461411 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:38.674150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:38.675321 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.676474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.678078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.679434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:38.681839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:38.703457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1218/2435] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:38 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:38.707574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:38.733232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f5f10e-9a1f-465f-b92a-c652094c611b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:38.752280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa18cfb-41ca-4853-b3ea-f0f769cbb2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:38.752988 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18cfb-41ca-4853-b3ea-f0f769cbb2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.753265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18cfb-41ca-4853-b3ea-f0f769cbb2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.753649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa18cfb-41ca-4853-b3ea-f0f769cbb2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.754417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18cfb-41ca-4853-b3ea-f0f769cbb2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:38.756092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa18cfb-41ca-4853-b3ea-f0f769cbb2b3 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:38.781406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1218/2436] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:38 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:38.785486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:38.809711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36653611-932a-4a4e-959a-44c643eaa74e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:38.828220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:38.829561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.833584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.834060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] PATH_INFO: `/v3/projects/24bad07d6c1c43ed8b61e2fc34acd62f/users/7e4163b15ebf45c184b14c8b5eb58ccc/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.863499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bad07d6c1c43ed8b61e2fc34acd62f, user_id=7e4163b15ebf45c184b14c8b5eb58ccc, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:38.867320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:38.883960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1219/2437] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:38 2021] PUT /identity/v3/projects/24bad07d6c1c43ed8b61e2fc34acd62f/users/7e4163b15ebf45c184b14c8b5eb58ccc/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:19:38.896288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e00a9-d97b-4c3f-b097-2f2d793c8d17 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:38.896689 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e00a9-d97b-4c3f-b097-2f2d793c8d17 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:38.896981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e00a9-d97b-4c3f-b097-2f2d793c8d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:38.951678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-489e00a9-d97b-4c3f-b097-2f2d793c8d17 None None] MFA Rules not processed for user `7e4163b15ebf45c184b14c8b5eb58ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:38.952943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-489e00a9-d97b-4c3f-b097-2f2d793c8d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:39.069839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1219/2438] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:38 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:39.080578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:39.084995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:39.211767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16e372-554f-4d2d-bed1-5bf6737df747 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:39.217982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:39.218757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:39.219104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:39.219480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:39.234014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:39.235766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:39.247461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1220/2439] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:39 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:43.805202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0b462-4af0-4196-8677-9741a4c96643 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:43.805800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0b462-4af0-4196-8677-9741a4c96643 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:43.813402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0b462-4af0-4196-8677-9741a4c96643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:43.860527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-d3d0b462-4af0-4196-8677-9741a4c96643 None None] MFA Rules not processed for user `d83e82f8ae2e4203b5f0c5d120c58792`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:43.861816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d3d0b462-4af0-4196-8677-9741a4c96643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:43.978398 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1220/2440] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:43 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:43.979353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:43.981372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:44.092845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b09b26-1441-4ea7-8b54-7706c36cb987 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:44.101447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:44.102332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:44.102612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:44.102883 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:44.103609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:44.105594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:44.154777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1221/2441] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:19:43 2021] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:44.157947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0b462-4af0-4196-8677-9741a4c96643 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:44.176153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0b462-4af0-4196-8677-9741a4c96643 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:44.258033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:44.259211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:44.259495 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:44.259788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:44.260640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:44.263363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:44.292404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1221/2442] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:19:44 2021] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:19:44.292631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:44.303437 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf84740-2067-48a7-9bcb-b845fdbf2efd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:44.310927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:44.312446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:44.312992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:44.313770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:44.315487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:44.319501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:44.339351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1222/2443] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:44 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:44.343857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:44.355907 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766faa8-ca2c-4a43-b344-37894e55db05 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:44.361953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:44.364605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:44.364605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:44.364605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] PATH_INFO: `/v3/projects/f616d231885846a299f65758235aaa76/users/752fb75be55d4cfbab72c0ea058347e6/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:44.385507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f616d231885846a299f65758235aaa76, user_id=752fb75be55d4cfbab72c0ea058347e6, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:44.388529 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:44.417359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1222/2444] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:44 2021] PUT /identity/v3/projects/f616d231885846a299f65758235aaa76/users/752fb75be55d4cfbab72c0ea058347e6/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:44.418765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:44.431220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080a7f8-7390-48de-bc18-76309995d03d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:44.500091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a0d15-e2d4-4201-a79e-9689780cab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:44.500911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a0d15-e2d4-4201-a79e-9689780cab0b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:44.501193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a0d15-e2d4-4201-a79e-9689780cab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:44.501638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a0d15-e2d4-4201-a79e-9689780cab0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:44.502277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a0d15-e2d4-4201-a79e-9689780cab0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:44.504149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a0d15-e2d4-4201-a79e-9689780cab0b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:44.517643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1223/2445] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:19:44 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:19:44.521802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:44.532851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f442712-9c89-4cc8-8031-95bcab46af6c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:44.538842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:44.539783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:44.540060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:44.540332 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] PATH_INFO: `/v3/projects/f616d231885846a299f65758235aaa76/users/752fb75be55d4cfbab72c0ea058347e6/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:44.542434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f616d231885846a299f65758235aaa76, user_id=752fb75be55d4cfbab72c0ea058347e6, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:44.545052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:44.563655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1223/2446] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:19:44 2021] PUT /identity/v3/projects/f616d231885846a299f65758235aaa76/users/752fb75be55d4cfbab72c0ea058347e6/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:53.051058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:53.051800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:53.051938 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:53.111984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] MFA Rules not processed for user `752fb75be55d4cfbab72c0ea058347e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:19:53.113935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:53.347044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1224/2447] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:53 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:19:53.358284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:53.361468 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:53.673095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b53e5d-f340-4aa9-b33e-c4f05802065c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:53.682994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5c0c7-9bcf-45df-bb26-46a73a5801da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:53.683801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5c0c7-9bcf-45df-bb26-46a73a5801da service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:53.684129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5c0c7-9bcf-45df-bb26-46a73a5801da service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:53.684750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5c0c7-9bcf-45df-bb26-46a73a5801da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:53.803584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5c0c7-9bcf-45df-bb26-46a73a5801da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:53.806242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5c0c7-9bcf-45df-bb26-46a73a5801da service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:53.825043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1224/2448] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:19:53 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:19:59.426588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:19:59.433677 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:19:59.568721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a3241-07a9-48d3-8a5c-42f607f3689c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:19:59.575638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:19:59.578221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:59.578688 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:59.579144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] PATH_INFO: `/v3/users/435d729ade12442c9ea4d29558deaebe` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:19:59.581387 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435d729ade12442c9ea4d29558deaebe)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:19:59.585107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:19:59.700483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435d729ade12442c9ea4d29558deaebe'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:59.705196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435d729ade12442c9ea4d29558deaebe'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:59.728085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435d729ade12442c9ea4d29558deaebe'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:59.752396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435d729ade12442c9ea4d29558deaebe'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:59.768384 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435d729ade12442c9ea4d29558deaebe'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:19:59.902640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1225/2449] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:19:59 2021] DELETE /identity/v3/users/435d729ade12442c9ea4d29558deaebe => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:19:59.906579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:19:59.907602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:19:59.908049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:00.009285 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:00.012359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:00.207921 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1225/2450] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:19:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:00.228392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:00.232023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:00.330716 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e0407-aeef-41f4-aea5-2b617c925296 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:00.337556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:00.338556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:00.339027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:00.339480 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:00.357112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:00.359732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:00.399331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1226/2451] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:01.150155 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:01.151844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:01.186956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186f41-2d19-4f14-9452-3e3e21ee60c6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:01.208955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:01.210079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:01.211736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:01.212863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] PATH_INFO: `/v3/projects/b2e2d087909448898eb62ca5b6aae29a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:01.216466 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e2d087909448898eb62ca5b6aae29a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:01.218784 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:01.357898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e2d087909448898eb62ca5b6aae29a', 'request_id': 'req-76ca0253-fbbc-48b0-b838-265e93f1e88d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:01.374337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e2d087909448898eb62ca5b6aae29a', 'request_id': 'req-76ca0253-fbbc-48b0-b838-265e93f1e88d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:01.408094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e2d087909448898eb62ca5b6aae29a', 'request_id': 'req-76ca0253-fbbc-48b0-b838-265e93f1e88d'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:01.470614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] The token cache is being invalidate because project b2e2d087909448898eb62ca5b6aae29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:20:01.471313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:01.478078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-76ca0253-fbbc-48b0-b838-265e93f1e88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:01.480512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1226/2452] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:20:01 2021] DELETE /identity/v3/projects/b2e2d087909448898eb62ca5b6aae29a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:01.826503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:01.829050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:01.874231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18b9f1-d6bc-4d94-8890-08ffbb602372 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:02.048251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:02.050412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:02.051260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:02.052047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] PATH_INFO: `/v3/users/7e4163b15ebf45c184b14c8b5eb58ccc` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:02.054561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e4163b15ebf45c184b14c8b5eb58ccc)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:02.058744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:02.135457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e4163b15ebf45c184b14c8b5eb58ccc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:02.136232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e4163b15ebf45c184b14c8b5eb58ccc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:02.144991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e4163b15ebf45c184b14c8b5eb58ccc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:02.162091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e4163b15ebf45c184b14c8b5eb58ccc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:02.173535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e4163b15ebf45c184b14c8b5eb58ccc'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:02.186702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1227/2453] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:20:01 2021] DELETE /identity/v3/users/7e4163b15ebf45c184b14c8b5eb58ccc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:02.193194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:02.194118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:02.194118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:02.221040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:02.222240 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:02.318946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1227/2454] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:02.325819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:02.328014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:02.435393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff70847-bd1e-449e-8008-4ec1cc9c3932 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:02.439397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd78be-5148-423d-8cf0-0248ec2c4530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:02.440068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd78be-5148-423d-8cf0-0248ec2c4530 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:02.440350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd78be-5148-423d-8cf0-0248ec2c4530 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:02.440625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd78be-5148-423d-8cf0-0248ec2c4530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:02.452286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd78be-5148-423d-8cf0-0248ec2c4530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:02.453819 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd78be-5148-423d-8cf0-0248ec2c4530 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:02.465957 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1228/2455] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:20:02.920387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:02.923023 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:02.949852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d119cd7-6d90-4f9f-82e7-14cc59cbf79b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:02.957876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:02.959533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:02.960239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:02.961184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] PATH_INFO: `/v3/projects/24bad07d6c1c43ed8b61e2fc34acd62f` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:02.964238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=24bad07d6c1c43ed8b61e2fc34acd62f)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:02.968898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:03.072717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bad07d6c1c43ed8b61e2fc34acd62f', 'request_id': 'req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:03.080902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bad07d6c1c43ed8b61e2fc34acd62f', 'request_id': 'req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:03.091946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bad07d6c1c43ed8b61e2fc34acd62f', 'request_id': 'req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:03.128750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] The token cache is being invalidate because project 24bad07d6c1c43ed8b61e2fc34acd62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:20:03.130232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:03.131377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-65c41af7-5928-4aae-8ff7-1d34b3b62b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:03.134304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1228/2456] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:20:02 2021] DELETE /identity/v3/projects/24bad07d6c1c43ed8b61e2fc34acd62f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:03.141614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.142453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.142828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.175669 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1822-2fea-4e44-95d5-ea27461768b1 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.176133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1822-2fea-4e44-95d5-ea27461768b1 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.176411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a1822-2fea-4e44-95d5-ea27461768b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.192761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:03.195528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:03.221082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-4b2a1822-2fea-4e44-95d5-ea27461768b1 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:03.222388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4b2a1822-2fea-4e44-95d5-ea27461768b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:03.307430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1229/2457] 10.222.0.31 () {58 vars in 967 bytes} [Tue Nov 16 03:20:03 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:03.309898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1229/2458] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:03.315681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6eadc-a371-4d8d-8a69-777bd2cad3ae None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.318833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6eadc-a371-4d8d-8a69-777bd2cad3ae None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.319814 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6eadc-a371-4d8d-8a69-777bd2cad3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.347183 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:03.349867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:03.358245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a7a6eadc-a371-4d8d-8a69-777bd2cad3ae None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:03.360716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a7a6eadc-a371-4d8d-8a69-777bd2cad3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:03.378057 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1230/2459] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:03.386898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6eadc-a371-4d8d-8a69-777bd2cad3ae None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:03.403654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6eadc-a371-4d8d-8a69-777bd2cad3ae None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:03.409061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:03.410396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.410734 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.411030 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.411873 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:20:03.412202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:03.415104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:03.445486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1231/2460] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:20:03.445486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:03.457396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49230a-294e-48b3-b579-ba1289935c58 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:03.470246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:03.471945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.472694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.473500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.475670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:03.480394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:03.527869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a873bfc-8787-4959-a93a-b7781cd91770 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:03.540403 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:03.540671 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1232/2461] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:03 2021] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:03.541313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.541723 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:03.541903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.542303 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.556955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:03.560774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:03.577977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1230/2462] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:20:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:20:03.707052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7258f-198c-4742-8644-dc4dfbfbf9fe admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:03.721411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:03.722470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.727422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.727422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.735140 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:03.741891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:03.788027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1233/2463] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:03 2021] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:03.790445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:03.823488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e30b-0183-4956-b199-aaf1a11b6afc service swift] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:03.835295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:03.836997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.836997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.836997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.838238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:03.840738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:03.856711 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1231/2464] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:03.862008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:03.877574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2993c2-3ec7-4bd3-9459-b4c98b67caef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:03.886756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67b76-f4f6-4d60-9f3c-4f2e292d67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:03.887809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67b76-f4f6-4d60-9f3c-4f2e292d67c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.888153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67b76-f4f6-4d60-9f3c-4f2e292d67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.888153 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67b76-f4f6-4d60-9f3c-4f2e292d67c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.889064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67b76-f4f6-4d60-9f3c-4f2e292d67c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:03.891098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67b76-f4f6-4d60-9f3c-4f2e292d67c4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:03.913952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1234/2465] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:03.916649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:03.931571 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b7c5a-7784-419a-a82c-d3280d006d53 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:03.948040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:03.949817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:03.949817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:03.949817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] PATH_INFO: `/v3/projects/76754ec1f4b143ceabbcb17af1aa513b/users/3a0b2c33c8044d5f8908aace9c01d236/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:03.982964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76754ec1f4b143ceabbcb17af1aa513b, user_id=3a0b2c33c8044d5f8908aace9c01d236, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:03.985950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:04.006347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1232/2466] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:03 2021] PUT /identity/v3/projects/76754ec1f4b143ceabbcb17af1aa513b/users/3a0b2c33c8044d5f8908aace9c01d236/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:04.014586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:04.014974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:04.015946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:04.038536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:04.040076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:04.133151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1235/2467] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:04.148846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:04.151276 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:04.258212 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae67187-fd03-4d11-8e5a-a7fce1bc2a1d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:04.262783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:04.263469 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:04.263747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:04.264050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:04.275426 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:04.276984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:04.290652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1233/2468] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:06.162045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:06.164152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:06.194505 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e3cd5-3985-4b7d-89b1-625c4dd2c4c6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:06.200407 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:06.201668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:06.202749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:06.203330 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] PATH_INFO: `/v3/users/c8fe1f34da024d0b8151c6f6760504ad` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:06.205152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fe1f34da024d0b8151c6f6760504ad)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:06.207406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:06.302299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fe1f34da024d0b8151c6f6760504ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:06.303431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fe1f34da024d0b8151c6f6760504ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:06.315209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fe1f34da024d0b8151c6f6760504ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:06.337224 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fe1f34da024d0b8151c6f6760504ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:06.352492 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-8e8d4820-ac87-4824-b7a0-b5546e197d8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fe1f34da024d0b8151c6f6760504ad'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:06.366903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1236/2469] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:20:06 2021] DELETE /identity/v3/users/c8fe1f34da024d0b8151c6f6760504ad => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:06.779681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:06.845127 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232da8e-21da-4373-8a3b-9d838a452efe service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:06.979742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:06.980796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:06.981802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:06.982391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] PATH_INFO: `/v3/projects/7abc18a290264877b7cce57e27056ccf` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:06.985856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abc18a290264877b7cce57e27056ccf)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:06.988077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:07.060990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abc18a290264877b7cce57e27056ccf', 'request_id': 'req-571697f7-3d5f-4840-b7b6-d1999c37d174'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:07.069163 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abc18a290264877b7cce57e27056ccf', 'request_id': 'req-571697f7-3d5f-4840-b7b6-d1999c37d174'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:07.076737 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abc18a290264877b7cce57e27056ccf', 'request_id': 'req-571697f7-3d5f-4840-b7b6-d1999c37d174'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:07.095061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] The token cache is being invalidate because project 7abc18a290264877b7cce57e27056ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:20:07.095952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:07.097901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-571697f7-3d5f-4840-b7b6-d1999c37d174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:07.102187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1234/2470] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:20:06 2021] DELETE /identity/v3/projects/7abc18a290264877b7cce57e27056ccf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:07.109528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a046-7864-428a-9eb5-6fbfca37d917 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.109820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a046-7864-428a-9eb5-6fbfca37d917 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.110020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709a046-7864-428a-9eb5-6fbfca37d917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.134932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7709a046-7864-428a-9eb5-6fbfca37d917 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:07.136752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7709a046-7864-428a-9eb5-6fbfca37d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:07.226450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1237/2471] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:07.236061 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186e57-fe27-42da-92e0-bf021f39ba90 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.236348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186e57-fe27-42da-92e0-bf021f39ba90 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.236628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186e57-fe27-42da-92e0-bf021f39ba90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.262528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-16186e57-fe27-42da-92e0-bf021f39ba90 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:07.264398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-16186e57-fe27-42da-92e0-bf021f39ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:07.281753 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1235/2472] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:07.287112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a046-7864-428a-9eb5-6fbfca37d917 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:07.300405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709a046-7864-428a-9eb5-6fbfca37d917 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:07.313375 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:07.315199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.315806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.316445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.319078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:20:07.319794 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:07.323230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:07.354565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1238/2473] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:20:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:20:07.355902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16186e57-fe27-42da-92e0-bf021f39ba90 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:07.366559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16186e57-fe27-42da-92e0-bf021f39ba90 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:07.372295 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:07.372980 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.373269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.373680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.374907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:07.383146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:07.445982 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1236/2474] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:07 2021] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:07.451560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:07.465570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836cd0f-a3e7-44fc-8790-88a0cb2c08bc admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:07.592230 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:07.593303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.594076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.594854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.596364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:07.599268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:07.631576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1239/2475] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:07 2021] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:07.632809 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:07.648371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b5502-a080-415c-a5bd-aeffd4c37991 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:07.655390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:07.656593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.657266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.657706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.658983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:07.661848 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:07.678813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1237/2476] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:07 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:20:07.682880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:07.701167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eacc1a-91a6-4533-ac90-ad1bf7655837 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:07.718815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d574fc4-7e49-4e7b-818d-b2c126bc3e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:07.719979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574fc4-7e49-4e7b-818d-b2c126bc3e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.720703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574fc4-7e49-4e7b-818d-b2c126bc3e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.721581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d574fc4-7e49-4e7b-818d-b2c126bc3e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.723675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d574fc4-7e49-4e7b-818d-b2c126bc3e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:07.726880 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d574fc4-7e49-4e7b-818d-b2c126bc3e56 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:07.764282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1240/2477] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:07 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:20:07.766405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:07.793746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559dfc-78fc-429c-a310-32dc0f9ffd9a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:07.802442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:07.804040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.804515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.805010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] PATH_INFO: `/v3/projects/96374743e52b427cb9c37ff40c90c66c/users/39762376f1eb4552a9802bb660c6d8b4/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.837231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96374743e52b427cb9c37ff40c90c66c, user_id=39762376f1eb4552a9802bb660c6d8b4, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:07.844549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:07.889709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1238/2478] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:07 2021] PUT /identity/v3/projects/96374743e52b427cb9c37ff40c90c66c/users/39762376f1eb4552a9802bb660c6d8b4/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:07.904583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe6e9-c1a1-47df-a984-e8662e2e2ab3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:07.905055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe6e9-c1a1-47df-a984-e8662e2e2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:07.905735 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fe6e9-c1a1-47df-a984-e8662e2e2ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:07.977796 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-6a3fe6e9-c1a1-47df-a984-e8662e2e2ab3 None None] MFA Rules not processed for user `39762376f1eb4552a9802bb660c6d8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:07.981021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6a3fe6e9-c1a1-47df-a984-e8662e2e2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:08.216502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1241/2479] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:07 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:08.230277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:08.237147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:08.593207 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bd9ef-d16e-403b-9228-82e649217c81 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:08.613478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1039-db40-492d-80b5-bf76fea514e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:08.614455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1039-db40-492d-80b5-bf76fea514e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:08.614954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1039-db40-492d-80b5-bf76fea514e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:08.616427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1039-db40-492d-80b5-bf76fea514e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:08.634213 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1039-db40-492d-80b5-bf76fea514e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:08.636613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1039-db40-492d-80b5-bf76fea514e1 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:08.695445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1239/2480] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:08 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:09.591904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ef9e-b9ce-4aa1-8ddc-63f41e6b9032 None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:09.592867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ef9e-b9ce-4aa1-8ddc-63f41e6b9032 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:09.593318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464ef9e-b9ce-4aa1-8ddc-63f41e6b9032 None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:09.595439 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1242/2481] 10.222.0.31 () {54 vars in 960 bytes} [Tue Nov 16 03:20:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 16 03:20:09.603807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960019-e08f-4d20-92a4-c626ac299816 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:09.604953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960019-e08f-4d20-92a4-c626ac299816 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:09.605556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12960019-e08f-4d20-92a4-c626ac299816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:09.674722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-12960019-e08f-4d20-92a4-c626ac299816 None None] MFA Rules not processed for user `4ef0f0386b384a09a87bcce51d172598`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:09.676244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-12960019-e08f-4d20-92a4-c626ac299816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:09.792569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1240/2482] 10.222.0.31 () {58 vars in 1057 bytes} [Tue Nov 16 03:20:09 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:09.808489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ef9e-b9ce-4aa1-8ddc-63f41e6b9032 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:09.835947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464ef9e-b9ce-4aa1-8ddc-63f41e6b9032 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:09.844473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92d089-d2c4-4031-86dc-ddef563da4e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:09.845159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d089-d2c4-4031-86dc-ddef563da4e9 service placement] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:09.845462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d089-d2c4-4031-86dc-ddef563da4e9 service placement] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:09.846001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92d089-d2c4-4031-86dc-ddef563da4e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:09.849292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bc92d089-d2c4-4031-86dc-ddef563da4e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:09.868489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92d089-d2c4-4031-86dc-ddef563da4e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:09.870804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc92d089-d2c4-4031-86dc-ddef563da4e9 service placement] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:09.887326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1243/2483] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:09 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:20:12.034583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960019-e08f-4d20-92a4-c626ac299816 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:12.130389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12960019-e08f-4d20-92a4-c626ac299816 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:12.136442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:12.137482 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:12.137847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:12.138192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] PATH_INFO: `/v3/users/39762376f1eb4552a9802bb660c6d8b4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:12.139713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] RBAC: Authorizing `identity:delete_user(user_id=39762376f1eb4552a9802bb660c6d8b4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:12.141899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:12.237829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39762376f1eb4552a9802bb660c6d8b4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:12.238968 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39762376f1eb4552a9802bb660c6d8b4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:12.251821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39762376f1eb4552a9802bb660c6d8b4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:12.280521 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39762376f1eb4552a9802bb660c6d8b4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:12.295489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cfaeaf82-ec9a-42ba-b7ab-76d14581981d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39762376f1eb4552a9802bb660c6d8b4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:12.303376 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1241/2484] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:20:12 2021] DELETE /identity/v3/users/39762376f1eb4552a9802bb660c6d8b4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:12.310273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:12.311866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:12.312324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:12.336639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:12.339165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:12.472389 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1244/2485] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:12.485187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:12.485187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:12.485187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:12.508049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:12.509707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:12.543367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] MFA Rules not processed for user `3a0b2c33c8044d5f8908aace9c01d236`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:12.544647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:12.637790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53aa55-2718-4c88-9370-d8ed0cd0926b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:12.646610 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:12.647432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:12.647783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:12.648254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:12.654347 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1242/2486] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:12 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:12.661792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:12.664001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:12.664703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:12.667511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:12.692386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83340749-1461-4838-b1d9-4359a34deb72 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:12.698444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1245/2487] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:12.701951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:12.703315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:12.703884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:12.704475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:12.706244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:12.718164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:12.778532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1243/2488] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:12 2021] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:12.783467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:12.809225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e3b02-7ab7-44b6-a95e-fb0cfb231051 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:12.949242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:12.950812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:12.951502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:12.952101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:12.954708 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:12.960792 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:13.017496 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1246/2489] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:12 2021] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:13.022901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:13.048261 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624cb4dc-35f5-4e6c-ba6f-ac012f0f589f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:13.064129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:13.064927 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:13.065243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:13.070013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:13.070942 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:13.073123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:13.104991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1244/2490] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:13.113804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:13.132875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b529aa-cb2c-40d6-b0bd-9a90c1eaa021 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:13.145275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:13.148107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:13.148594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:13.149077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] PATH_INFO: `/v3/projects/ba3f648fc9dd4cd3b5f5d20f45efc3fe/users/a9f07b8a6d334d48bd4575a8b04d489d/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:13.203557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3f648fc9dd4cd3b5f5d20f45efc3fe, user_id=a9f07b8a6d334d48bd4575a8b04d489d, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:13.211325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:13.255968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1247/2491] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:13 2021] PUT /identity/v3/projects/ba3f648fc9dd4cd3b5f5d20f45efc3fe/users/a9f07b8a6d334d48bd4575a8b04d489d/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:13.256270 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:13.272991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df882941-87be-4c73-be75-ff84cb06dea8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:13.424156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:13.427525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:13.441810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:13.442818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:13.443239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:13.443911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:13.444705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:13.446451 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:13.460767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1245/2492] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:20:13.466546 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:13.489200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc1269-05fe-4cfb-ad3c-e8107e437399 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:13.498104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93feb513-4a07-4538-b23e-f6aa954ef8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:13.499631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feb513-4a07-4538-b23e-f6aa954ef8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:13.500168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feb513-4a07-4538-b23e-f6aa954ef8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:13.500828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93feb513-4a07-4538-b23e-f6aa954ef8f5 admin admin] PATH_INFO: `/v3/projects/ba3f648fc9dd4cd3b5f5d20f45efc3fe/users/a9f07b8a6d334d48bd4575a8b04d489d/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:13.505394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93feb513-4a07-4538-b23e-f6aa954ef8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3f648fc9dd4cd3b5f5d20f45efc3fe, user_id=a9f07b8a6d334d48bd4575a8b04d489d, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:13.510280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93feb513-4a07-4538-b23e-f6aa954ef8f5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:13.530110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1246/2493] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:13 2021] PUT /identity/v3/projects/ba3f648fc9dd4cd3b5f5d20f45efc3fe/users/a9f07b8a6d334d48bd4575a8b04d489d/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:20:13.535594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6e670-98b2-4264-b0a6-4fd8c6a8ac15 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:13.602435 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:13.603445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:13.603730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:13.604151 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] PATH_INFO: `/v3/projects/96374743e52b427cb9c37ff40c90c66c` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:13.605567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] RBAC: Authorizing `identity:delete_project(project_id=96374743e52b427cb9c37ff40c90c66c)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:13.608113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:13.683118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96374743e52b427cb9c37ff40c90c66c', 'request_id': 'req-4f44f33f-177f-4f54-a7be-05a31432532c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:13.694394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96374743e52b427cb9c37ff40c90c66c', 'request_id': 'req-4f44f33f-177f-4f54-a7be-05a31432532c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:13.706471 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96374743e52b427cb9c37ff40c90c66c', 'request_id': 'req-4f44f33f-177f-4f54-a7be-05a31432532c'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:13.735765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] The token cache is being invalidate because project 96374743e52b427cb9c37ff40c90c66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:20:13.736117 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:13.737573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f44f33f-177f-4f54-a7be-05a31432532c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:13.747809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1248/2494] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:20:13 2021] DELETE /identity/v3/projects/96374743e52b427cb9c37ff40c90c66c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:20:13.751388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ebf56-0a4b-4f00-81e0-cac3660e67ae None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:13.752239 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ebf56-0a4b-4f00-81e0-cac3660e67ae None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:13.752827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ebf56-0a4b-4f00-81e0-cac3660e67ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:13.779538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2f5ebf56-0a4b-4f00-81e0-cac3660e67ae None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:13.781345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2f5ebf56-0a4b-4f00-81e0-cac3660e67ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:13.914044 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1247/2495] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:13.916413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e035a-2272-4319-810d-d07c8d43a824 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:13.917058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e035a-2272-4319-810d-d07c8d43a824 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:13.917058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e035a-2272-4319-810d-d07c8d43a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:13.964060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-909e035a-2272-4319-810d-d07c8d43a824 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:13.966084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-909e035a-2272-4319-810d-d07c8d43a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:13.989239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1249/2496] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:13.994348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ebf56-0a4b-4f00-81e0-cac3660e67ae None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:14.014025 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ebf56-0a4b-4f00-81e0-cac3660e67ae None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:14.029022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:14.030070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:14.032083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:14.032693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:14.034071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:20:14.036669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:14.042211 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:14.097966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e035a-2272-4319-810d-d07c8d43a824 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:14.102494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1248/2497] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:20:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:20:14.111756 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e035a-2272-4319-810d-d07c8d43a824 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:14.126953 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:14.127720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:14.128000 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:14.128292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:14.129232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:14.131537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:14.165581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1250/2498] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:14 2021] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:20:14.170733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:14.190289 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6150d-b309-4a05-9523-bb3100d82c6e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:14.281560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:14.282994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:14.283550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:14.285622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:14.286738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:14.290720 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:14.320368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1249/2499] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:14 2021] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:20:14.330145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:14.345365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ddb85-b35e-449f-9cb3-1e28acaf9885 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:14.386411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:14.389510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:14.389871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:14.393974 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:14.395344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:14.400871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:14.424790 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1251/2500] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:20:14.427022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:14.445843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90835b-aeeb-458c-8236-1def6b0dbac5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:14.460665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ddd5a-4e37-4f0f-ac94-0ca63cb363fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:14.462770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ddd5a-4e37-4f0f-ac94-0ca63cb363fa admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:14.472133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ddd5a-4e37-4f0f-ac94-0ca63cb363fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:14.473619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ddd5a-4e37-4f0f-ac94-0ca63cb363fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:14.478009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ddd5a-4e37-4f0f-ac94-0ca63cb363fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:14.485196 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ddd5a-4e37-4f0f-ac94-0ca63cb363fa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:14.521896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1250/2501] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:14.526646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:14.544442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696cad7-a4b1-4563-80a4-2896f1942d22 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:14.562310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:14.564027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:14.564606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:14.565152 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] PATH_INFO: `/v3/projects/ec26dd4c49f74ef7b1b41c9d379e7aa6/users/8051d632998f433f88cff6dce1467fd7/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:14.611836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec26dd4c49f74ef7b1b41c9d379e7aa6, user_id=8051d632998f433f88cff6dce1467fd7, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:14.614729 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:14.647141 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1252/2502] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:14 2021] PUT /identity/v3/projects/ec26dd4c49f74ef7b1b41c9d379e7aa6/users/8051d632998f433f88cff6dce1467fd7/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:20:14.652881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8faaf-7d65-4e67-bf99-596c513f9a1f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:14.653243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8faaf-7d65-4e67-bf99-596c513f9a1f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:14.653491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8faaf-7d65-4e67-bf99-596c513f9a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:14.711090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8ee8faaf-7d65-4e67-bf99-596c513f9a1f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:14.712373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8ee8faaf-7d65-4e67-bf99-596c513f9a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:14.876774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1251/2503] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:14.896109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:14.901328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:15.018350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d99fa-98c4-4d92-b2ef-1d2a99cf4221 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:15.024237 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:15.025260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:15.025962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:15.026428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:15.041815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:15.044123 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:15.058368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1253/2504] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:16.623099 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08a962-6c7e-4713-930c-293bfbacc5ba None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:16.624563 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08a962-6c7e-4713-930c-293bfbacc5ba None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:16.625953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08a962-6c7e-4713-930c-293bfbacc5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:16.701022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6c08a962-6c7e-4713-930c-293bfbacc5ba None None] MFA Rules not processed for user `8051d632998f433f88cff6dce1467fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:16.703399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6c08a962-6c7e-4713-930c-293bfbacc5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:16.858223 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1252/2505] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:16 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:16.876834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:16.879678 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:17.008808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23751dcf-1f58-4664-aaae-9ee833fc2a84 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:17.017341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e725c84f-51f7-45ce-a5b9-fb151fad5790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:17.019204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725c84f-51f7-45ce-a5b9-fb151fad5790 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:17.019776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725c84f-51f7-45ce-a5b9-fb151fad5790 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:17.020361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e725c84f-51f7-45ce-a5b9-fb151fad5790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:17.036791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725c84f-51f7-45ce-a5b9-fb151fad5790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:17.040087 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e725c84f-51f7-45ce-a5b9-fb151fad5790 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:17.057778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1254/2506] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:16 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:18.903186 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda774fd-8082-4206-bbf1-b5ee33c144b4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:18.903854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda774fd-8082-4206-bbf1-b5ee33c144b4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:18.903854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda774fd-8082-4206-bbf1-b5ee33c144b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:18.951079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-bda774fd-8082-4206-bbf1-b5ee33c144b4 None None] MFA Rules not processed for user `8051d632998f433f88cff6dce1467fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:18.955570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-bda774fd-8082-4206-bbf1-b5ee33c144b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:18.980943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1253/2507] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:18 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:19.155267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cd255-6260-433d-b736-111cd93daf1c None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:19.156118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cd255-6260-433d-b736-111cd93daf1c None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:19.156118 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cd255-6260-433d-b736-111cd93daf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:19.223418 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-998cd255-6260-433d-b736-111cd93daf1c None None] MFA Rules not processed for user `d83e82f8ae2e4203b5f0c5d120c58792`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:19.227028 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-998cd255-6260-433d-b736-111cd93daf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:19.389593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1255/2508] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:19 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:24.309608 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:24.310253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:24.310253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:24.348928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cd255-6260-433d-b736-111cd93daf1c None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:24.350582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-998cd255-6260-433d-b736-111cd93daf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:24.377404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cd255-6260-433d-b736-111cd93daf1c None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:24.377862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] MFA Rules not processed for user `a9f07b8a6d334d48bd4575a8b04d489d`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:24.380458 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:24.392029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:24.394981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:24.395780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:24.396234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] PATH_INFO: `/v3/users/681c813529d941f688bff8333ad3b089` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:24.398076 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=681c813529d941f688bff8333ad3b089)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:24.400876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:24.527526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681c813529d941f688bff8333ad3b089'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:24.529994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681c813529d941f688bff8333ad3b089'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:24.552612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1254/2509] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:24 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:24.560733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681c813529d941f688bff8333ad3b089'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:24.568725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:24.570775 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:24.595966 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681c813529d941f688bff8333ad3b089'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:24.613390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-19143158-b2e4-483a-b829-4b114e22b5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681c813529d941f688bff8333ad3b089'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:24.629759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1256/2510] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:20:24 2021] DELETE /identity/v3/users/681c813529d941f688bff8333ad3b089 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:24.877217 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c8491-d50a-486e-80fa-a8fdba505935 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:24.987988 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:24.990297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:24.991707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:24.992732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:25.025842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:25.184131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:25.187947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:25.213638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1255/2511] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:20:25.511898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:25.512614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:25.512614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:25.529294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:25.531803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:25.599944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:25.601392 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:25.751902 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8fd16-954c-49c7-9f0a-c79138e95317 service glance] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:25.767080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:25.770264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:25.771382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:25.771729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] PATH_INFO: `/v3/projects/61a2e084639344ff8e8d5ade2eef51d0` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:25.774657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=61a2e084639344ff8e8d5ade2eef51d0)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:25.777662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1257/2512] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:20:25 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:25.786801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:25.847142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:25.850926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:25.961971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61a2e084639344ff8e8d5ade2eef51d0', 'request_id': 'req-1616abe0-d892-4dad-9b31-8faf820678ec'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:25.979975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61a2e084639344ff8e8d5ade2eef51d0', 'request_id': 'req-1616abe0-d892-4dad-9b31-8faf820678ec'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:26.001576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61a2e084639344ff8e8d5ade2eef51d0', 'request_id': 'req-1616abe0-d892-4dad-9b31-8faf820678ec'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:26.028291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] The token cache is being invalidate because project 61a2e084639344ff8e8d5ade2eef51d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:20:26.028858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:26.030068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1616abe0-d892-4dad-9b31-8faf820678ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:26.042349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1256/2513] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:20:25 2021] DELETE /identity/v3/projects/61a2e084639344ff8e8d5ade2eef51d0 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:20:26.045351 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31f17-0a4d-4b97-9199-f164ba3e55af None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:26.045649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31f17-0a4d-4b97-9199-f164ba3e55af None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:26.050379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31f17-0a4d-4b97-9199-f164ba3e55af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:26.110098 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-06e31f17-0a4d-4b97-9199-f164ba3e55af None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:26.115420 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-06e31f17-0a4d-4b97-9199-f164ba3e55af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:26.221205 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a8a0c-415e-4e75-a532-403746d578bf None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:26.298672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1257/2514] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:26.309070 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264807-0417-41c9-a76f-dc6e4f9b3da6 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:26.309827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264807-0417-41c9-a76f-dc6e4f9b3da6 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:26.311671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264807-0417-41c9-a76f-dc6e4f9b3da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:26.350585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-a1264807-0417-41c9-a76f-dc6e4f9b3da6 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:26.352334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a1264807-0417-41c9-a76f-dc6e4f9b3da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:26.365548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1258/2515] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:26.371100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264807-0417-41c9-a76f-dc6e4f9b3da6 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:26.384317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264807-0417-41c9-a76f-dc6e4f9b3da6 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:26.391154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:26.393042 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:26.393601 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:26.394668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:26.395509 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:26.396445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:26.396901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:26.397494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:26.398489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:20:26.398960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:26.401216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:26.401702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:26.431795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1259/2516] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:20:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:20:26.436588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:26.495646 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f657de9-a118-431b-9e37-f7bf17e9bc27 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:26.506561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:26.509047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:26.509746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:26.510288 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:26.511301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:26.515868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:26.551362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:26.553157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:26.557999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1260/2517] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:26 2021] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:26.562696 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:26.570556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1258/2518] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:20:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:20:26.748874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d1ff-10fa-4530-a60d-a15bd7529969 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:26.785058 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:26.787352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:26.787899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:26.788373 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:26.798399 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:26.804702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:26.868532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1261/2519] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:26 2021] POST /identity/v3/users => generated 293 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:26.869235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:26.889458 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440568d8-7381-41d0-a93c-f7a7fe81ec64 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:26.942653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:26.944486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:26.952879 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:26.954083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:26.969290 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:26.988718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:27.053884 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1259/2520] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:26 2021] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:27.056274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:27.073071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3edc4c-3865-4d20-a23f-99c33d820078 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:27.088378 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4d7528-70ca-4b71-a44c-7174f770240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:27.089197 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7528-70ca-4b71-a44c-7174f770240e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:27.089622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7528-70ca-4b71-a44c-7174f770240e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:27.090018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4d7528-70ca-4b71-a44c-7174f770240e admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:27.090981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d7528-70ca-4b71-a44c-7174f770240e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:27.095453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4d7528-70ca-4b71-a44c-7174f770240e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:27.122519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1262/2521] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:27 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:27.124517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:27.140461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd7c62-d1fd-493b-9661-1a34f7257826 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:27.147663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:27.149383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:27.149644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:27.150072 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] PATH_INFO: `/v3/projects/71fd9633ecda4a2b98d9fd43520cfd3a/users/b8a64486bc0d483fa18566fdf43aec9c/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:27.191400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fd9633ecda4a2b98d9fd43520cfd3a, user_id=b8a64486bc0d483fa18566fdf43aec9c, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:27.199523 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:27.244051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1260/2522] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:27 2021] PUT /identity/v3/projects/71fd9633ecda4a2b98d9fd43520cfd3a/users/b8a64486bc0d483fa18566fdf43aec9c/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:27.255806 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:27.256255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:27.256633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:27.364021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] MFA Rules not processed for user `b8a64486bc0d483fa18566fdf43aec9c`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:27.366659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:27.484484 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1263/2523] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:27.497822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:27.501857 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:27.686782 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d058-6936-4104-8418-2d9f12f6d1ef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:27.703358 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:27.704165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:27.704539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:27.704903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:27.727928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:27.734634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:27.770934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1261/2524] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:33.729907 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:33.733678 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:33.880813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091787a2-ef34-4508-bf45-fadaa51afa89 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:33.886702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:33.888237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:33.888744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:33.889379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] PATH_INFO: `/v3/users/1f1edff84d4e4fc99dd8158012f3e77d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:33.892539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1edff84d4e4fc99dd8158012f3e77d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:33.896191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:33.986499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1edff84d4e4fc99dd8158012f3e77d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:33.987911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1edff84d4e4fc99dd8158012f3e77d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:33.998226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1edff84d4e4fc99dd8158012f3e77d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.039520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1edff84d4e4fc99dd8158012f3e77d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.062021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-e66cc545-e0aa-48c6-a219-2c7d33c2f60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1edff84d4e4fc99dd8158012f3e77d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.073613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1264/2525] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:20:33 2021] DELETE /identity/v3/users/1f1edff84d4e4fc99dd8158012f3e77d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:34.521165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:34.538016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74675dcb-82f8-46aa-9b5f-121014364604 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:34.773605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:34.775352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:34.775877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:34.776227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] PATH_INFO: `/v3/projects/e487df53678d4cd890ccf9e6c950fa5e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:34.777808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e487df53678d4cd890ccf9e6c950fa5e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:34.781252 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:34.928477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e487df53678d4cd890ccf9e6c950fa5e', 'request_id': 'req-b39de5dd-4278-413e-8b27-34dbabc400a8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.941594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e487df53678d4cd890ccf9e6c950fa5e', 'request_id': 'req-b39de5dd-4278-413e-8b27-34dbabc400a8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.958833 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e487df53678d4cd890ccf9e6c950fa5e', 'request_id': 'req-b39de5dd-4278-413e-8b27-34dbabc400a8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.985516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] The token cache is being invalidate because project e487df53678d4cd890ccf9e6c950fa5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:20:34.985979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.986941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b39de5dd-4278-413e-8b27-34dbabc400a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:34.989222 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1262/2526] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:20:34 2021] DELETE /identity/v3/projects/e487df53678d4cd890ccf9e6c950fa5e => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:34.995548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac18c91-f0b4-4218-9c15-9efed77b557f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:34.996185 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac18c91-f0b4-4218-9c15-9efed77b557f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:34.996185 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac18c91-f0b4-4218-9c15-9efed77b557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.026146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8ac18c91-f0b4-4218-9c15-9efed77b557f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:35.028072 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8ac18c91-f0b4-4218-9c15-9efed77b557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:35.150852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1265/2527] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:35.161630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510209-15a2-4246-b246-32012a494508 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.161630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510209-15a2-4246-b246-32012a494508 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.164341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc510209-15a2-4246-b246-32012a494508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.194657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bc510209-15a2-4246-b246-32012a494508 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:35.195927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bc510209-15a2-4246-b246-32012a494508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:35.207830 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1263/2528] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:35.212247 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac18c91-f0b4-4218-9c15-9efed77b557f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:35.232338 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac18c91-f0b4-4218-9c15-9efed77b557f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:35.257581 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:35.259392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.259939 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.260378 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.262121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:20:35.262870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:35.265389 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:35.290807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510209-15a2-4246-b246-32012a494508 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:35.296125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1266/2529] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:20:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:20:35.301800 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc510209-15a2-4246-b246-32012a494508 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:35.308338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:35.309758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.309758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.309758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.310513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:35.312494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:35.368847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:35.382296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1264/2530] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:35 2021] POST /identity/v3/projects => generated 389 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:35.398369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb4721-a243-4b5f-a09b-41bc3175ae9f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:35.523357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:35.524141 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.524489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.524828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.525688 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:35.527838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:35.565501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1267/2531] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:35 2021] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:35.568868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:35.589535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4865b7-31fc-421c-8a22-ac347a225dcf admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:35.598171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:35.599333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.599852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.600344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.602075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:35.606098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:35.630663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1265/2532] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:35.635849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:35.653575 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316fe2-62b1-471e-be0d-4debce8cc6b7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:35.670380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3599e-6989-4adb-92c3-ed4f0852b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:35.671168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3599e-6989-4adb-92c3-ed4f0852b589 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.671679 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3599e-6989-4adb-92c3-ed4f0852b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.672191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3599e-6989-4adb-92c3-ed4f0852b589 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.673577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3599e-6989-4adb-92c3-ed4f0852b589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:35.678556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3599e-6989-4adb-92c3-ed4f0852b589 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:35.713107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1268/2533] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:35.719215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:35.736061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d98c5-da75-4976-8d0f-3144b7662e4d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:35.750738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:35.752509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.753038 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.753637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] PATH_INFO: `/v3/projects/2852179c69834bda8a41052f2d958cd4/users/d6268d6bbeb242949ba4aca2e1debde6/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.796384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2852179c69834bda8a41052f2d958cd4, user_id=d6268d6bbeb242949ba4aca2e1debde6, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:35.803138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:35.841605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1266/2534] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:35 2021] PUT /identity/v3/projects/2852179c69834bda8a41052f2d958cd4/users/d6268d6bbeb242949ba4aca2e1debde6/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:20:35.847311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:35.847619 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:35.847885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:35.881777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:35.889253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:36.059146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1269/2535] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:36.073567 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:36.077061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:36.279636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb1a110-ac05-4f2a-a1a7-814d49e734cb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:36.300247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631a920-ba68-4765-becf-99866da0525c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:36.303318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631a920-ba68-4765-becf-99866da0525c service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:36.304056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631a920-ba68-4765-becf-99866da0525c service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:36.304542 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631a920-ba68-4765-becf-99866da0525c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:36.346036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631a920-ba68-4765-becf-99866da0525c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:36.350965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631a920-ba68-4765-becf-99866da0525c service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:36.376945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1267/2536] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:38.105960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:38.108271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:38.135095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f53ef-e1f8-4d2d-ac27-93689a2021a3 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:38.141925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:38.143170 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:38.143616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:38.144421 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] PATH_INFO: `/v3/users/b8a64486bc0d483fa18566fdf43aec9c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:38.146319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a64486bc0d483fa18566fdf43aec9c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:38.149096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:38.258756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a64486bc0d483fa18566fdf43aec9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:38.269628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a64486bc0d483fa18566fdf43aec9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:38.310624 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a64486bc0d483fa18566fdf43aec9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:38.360357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a64486bc0d483fa18566fdf43aec9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:38.380539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a64486bc0d483fa18566fdf43aec9c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:38.398346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1270/2537] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:20:38 2021] DELETE /identity/v3/users/b8a64486bc0d483fa18566fdf43aec9c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:38.400297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:38.401014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:38.401014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:38.436101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:38.439571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:38.575698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1268/2538] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:38.589588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:38.592911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:38.687464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea932c-6ad7-48d0-99e2-d2c2ec0b094f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:38.693417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebb2d4-849f-4f2b-b057-1747db23f8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:38.694152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb2d4-849f-4f2b-b057-1747db23f8fb service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:38.694443 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb2d4-849f-4f2b-b057-1747db23f8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:38.694702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebb2d4-849f-4f2b-b057-1747db23f8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:38.708122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebb2d4-849f-4f2b-b057-1747db23f8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:38.710313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebb2d4-849f-4f2b-b057-1747db23f8fb service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:38.725814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1271/2539] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:39.533448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:39.535621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:39.552783 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cabde-3bb6-48fb-ab15-47f28498e609 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:39.568868 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:39.571986 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:39.573177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:39.574160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] PATH_INFO: `/v3/projects/71fd9633ecda4a2b98d9fd43520cfd3a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:39.579025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fd9633ecda4a2b98d9fd43520cfd3a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:39.583553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:39.715750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fd9633ecda4a2b98d9fd43520cfd3a', 'request_id': 'req-aa4de244-3675-448f-b2d4-d573aeb0e101'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:39.727209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fd9633ecda4a2b98d9fd43520cfd3a', 'request_id': 'req-aa4de244-3675-448f-b2d4-d573aeb0e101'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:39.735310 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fd9633ecda4a2b98d9fd43520cfd3a', 'request_id': 'req-aa4de244-3675-448f-b2d4-d573aeb0e101'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:39.753821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] The token cache is being invalidate because project 71fd9633ecda4a2b98d9fd43520cfd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:20:39.754103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:39.755109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-aa4de244-3675-448f-b2d4-d573aeb0e101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:20:39.757104 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1269/2540] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:20:39 2021] DELETE /identity/v3/projects/71fd9633ecda4a2b98d9fd43520cfd3a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:39.763628 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a10bdf-6176-4461-a71a-e688fc078e36 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:39.764164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a10bdf-6176-4461-a71a-e688fc078e36 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:39.764164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a10bdf-6176-4461-a71a-e688fc078e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:39.793074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-20a10bdf-6176-4461-a71a-e688fc078e36 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:39.794641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-20a10bdf-6176-4461-a71a-e688fc078e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:39.892266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1272/2541] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:39.894476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc007-0694-42ae-b411-b21c20ecde1f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:39.894932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc007-0694-42ae-b411-b21c20ecde1f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:39.895394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bc007-0694-42ae-b411-b21c20ecde1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:39.927561 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2f3bc007-0694-42ae-b411-b21c20ecde1f None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:39.929694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2f3bc007-0694-42ae-b411-b21c20ecde1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:39.943945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1270/2542] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:39.948747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a10bdf-6176-4461-a71a-e688fc078e36 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:39.959357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a10bdf-6176-4461-a71a-e688fc078e36 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:39.965962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:39.966878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:39.967275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:39.967656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:39.968760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:20:39.969189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:39.970994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:39.992230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1273/2543] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:20:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:20:39.993618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc007-0694-42ae-b411-b21c20ecde1f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:40.004158 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bc007-0694-42ae-b411-b21c20ecde1f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:40.010998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:40.014742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:40.015084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:40.015291 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:40.016677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:40.019385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:40.075234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1271/2544] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:39 2021] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:40.076769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:40.093875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f4e89-5633-436b-879d-e4e6958640e4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:40.184121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:40.184812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:40.185090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:40.185359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:40.186114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:40.188053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:40.227297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1274/2545] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:40 2021] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:20:40.231080 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:40.246780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8e19a-a61c-4bf1-9afe-19411233f876 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:40.255233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:40.256075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:40.256428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:40.256772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:40.257647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:40.259761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:40.295551 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1272/2546] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:40 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:40.296805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:40.307856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6237f7d-2ad8-42b3-916c-b11626065621 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:40.332314 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f21ce7-e2c0-46c0-9917-d21f6b59714a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:40.333110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21ce7-e2c0-46c0-9917-d21f6b59714a admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:40.333475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21ce7-e2c0-46c0-9917-d21f6b59714a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:40.333867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f21ce7-e2c0-46c0-9917-d21f6b59714a admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:40.334754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f21ce7-e2c0-46c0-9917-d21f6b59714a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:40.336490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f21ce7-e2c0-46c0-9917-d21f6b59714a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:40.350891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1275/2547] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:40 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:40.354954 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:40.386579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c0aa-3ff0-4de3-a21c-fc24ae626ec4 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:40.403032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:40.404379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:40.404930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:40.405304 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] PATH_INFO: `/v3/projects/944e3fb6d9ef45e1a24d3d8c40615a00/users/c56a50bf7a3342919d989858e4239d87/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:40.423474 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=944e3fb6d9ef45e1a24d3d8c40615a00, user_id=c56a50bf7a3342919d989858e4239d87, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:40.426997 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:40.459035 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1273/2548] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:40 2021] PUT /identity/v3/projects/944e3fb6d9ef45e1a24d3d8c40615a00/users/c56a50bf7a3342919d989858e4239d87/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:20:40.469409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d194c-7d29-4299-8d57-fcadacf31660 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:40.470092 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d194c-7d29-4299-8d57-fcadacf31660 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:40.470366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d194c-7d29-4299-8d57-fcadacf31660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:40.553684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-964d194c-7d29-4299-8d57-fcadacf31660 None None] MFA Rules not processed for user `c56a50bf7a3342919d989858e4239d87`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:40.555515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-964d194c-7d29-4299-8d57-fcadacf31660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:40.754145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1276/2549] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:40 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:40.755397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:40.841519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904176be-cbe6-43a9-88f0-e9f9c720d03c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:40.855721 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:40.856422 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:40.856712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:40.856995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:40.858133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:40.860326 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:40.918027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1274/2550] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:20:40 2021] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:20:40.922490 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d194c-7d29-4299-8d57-fcadacf31660 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:40.945559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d194c-7d29-4299-8d57-fcadacf31660 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:41.115508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:41.121269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:41.123348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:41.123684 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:41.129018 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:41.135145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:41.190027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1277/2551] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:20:40 2021] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:20:41.201416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:41.218612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8045d-40c3-4db7-a9db-7a9951d14697 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:41.236412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:41.242041 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:41.242372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:41.242664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:41.246328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:41.250313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:41.289212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1275/2552] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:41 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:41.290862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:41.306322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8effa5-fdfc-431a-b302-aa370efbb9da admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:41.326203 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:41.327148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:41.327568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:41.327846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] PATH_INFO: `/v3/projects/004cbe1fde9049deb6526d1ac73bf596/users/f03d6cbb80aa4b2dbf8e2148a3a7447e/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:41.352236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004cbe1fde9049deb6526d1ac73bf596, user_id=f03d6cbb80aa4b2dbf8e2148a3a7447e, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:41.355885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:41.384292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1278/2553] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:41 2021] PUT /identity/v3/projects/004cbe1fde9049deb6526d1ac73bf596/users/f03d6cbb80aa4b2dbf8e2148a3a7447e/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:20:41.388417 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:41.410147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49babfb9-ac53-4f73-abfd-82ccdc3894f2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:41.602362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54f135-8c7f-4baf-a754-882749818974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:41.603077 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f135-8c7f-4baf-a754-882749818974 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:41.603362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f135-8c7f-4baf-a754-882749818974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:41.603627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54f135-8c7f-4baf-a754-882749818974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:41.604394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54f135-8c7f-4baf-a754-882749818974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:41.606147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54f135-8c7f-4baf-a754-882749818974 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:41.669154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1276/2554] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:20:41 2021] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:20:41.675465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:41.729492 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316b5f6-9a5f-4ff5-a841-8b0b68b34d95 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:41.761874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:41.764401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:41.764537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:41.770461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] PATH_INFO: `/v3/projects/004cbe1fde9049deb6526d1ac73bf596/users/f03d6cbb80aa4b2dbf8e2148a3a7447e/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:41.790400 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004cbe1fde9049deb6526d1ac73bf596, user_id=f03d6cbb80aa4b2dbf8e2148a3a7447e, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:41.805554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:41.860446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1279/2555] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:20:41 2021] PUT /identity/v3/projects/004cbe1fde9049deb6526d1ac73bf596/users/f03d6cbb80aa4b2dbf8e2148a3a7447e/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:20:41.880763 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbcd07-87a2-4550-a395-61237a065a91 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:41.882303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbcd07-87a2-4550-a395-61237a065a91 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:41.883218 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbcd07-87a2-4550-a395-61237a065a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:42.007344 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-89fbcd07-87a2-4550-a395-61237a065a91 None None] MFA Rules not processed for user `f03d6cbb80aa4b2dbf8e2148a3a7447e`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:42.009343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-89fbcd07-87a2-4550-a395-61237a065a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:42.264621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1277/2556] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:41 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:42.295155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:42.297074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:42.509734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f4945-a7c3-4492-afef-d6a296c650d0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:42.539301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65eb56-4a45-44d1-9aff-8f1024784cf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:42.540460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eb56-4a45-44d1-9aff-8f1024784cf7 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:42.540962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eb56-4a45-44d1-9aff-8f1024784cf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:42.546162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65eb56-4a45-44d1-9aff-8f1024784cf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:42.607965 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65eb56-4a45-44d1-9aff-8f1024784cf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:42.612145 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65eb56-4a45-44d1-9aff-8f1024784cf7 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:42.649569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1280/2557] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:42 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:42.814560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbcd07-87a2-4550-a395-61237a065a91 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:42.833738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbcd07-87a2-4550-a395-61237a065a91 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:42.846484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:42.849248 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:42.849650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:42.849965 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:42.993335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:42.994835 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:43.048425 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1278/2558] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:42 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:44.706232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769953-f632-4c4a-b7db-a9a1de0b14ce None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:44.706859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769953-f632-4c4a-b7db-a9a1de0b14ce None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:44.706859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32769953-f632-4c4a-b7db-a9a1de0b14ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:44.761292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-32769953-f632-4c4a-b7db-a9a1de0b14ce None None] MFA Rules not processed for user `d6268d6bbeb242949ba4aca2e1debde6`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:44.764453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-32769953-f632-4c4a-b7db-a9a1de0b14ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:44.917329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1281/2559] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:44 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:44.931984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:44.934001 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:45.173807 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda481d-5397-4df9-a25d-a5b9cd7cf63c service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:45.191998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71576a3a-d4da-4ccc-b754-e03c9642dc73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:45.192788 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576a3a-d4da-4ccc-b754-e03c9642dc73 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:45.193075 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576a3a-d4da-4ccc-b754-e03c9642dc73 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:45.198236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71576a3a-d4da-4ccc-b754-e03c9642dc73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:45.229866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71576a3a-d4da-4ccc-b754-e03c9642dc73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:45.232369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71576a3a-d4da-4ccc-b754-e03c9642dc73 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:45.271838 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1279/2560] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:44 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:20:46.090777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f06a1-a63a-4a45-b879-51c627c7cae9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:46.091637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f06a1-a63a-4a45-b879-51c627c7cae9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:46.091637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f06a1-a63a-4a45-b879-51c627c7cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:46.118083 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-352f06a1-a63a-4a45-b879-51c627c7cae9 None None] MFA Rules not processed for user `3a0b2c33c8044d5f8908aace9c01d236`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:46.120793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-352f06a1-a63a-4a45-b879-51c627c7cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:46.221842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1282/2561] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:46 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:20:48.350224 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:48.351720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:48.351720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:48.375146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] MFA Rules not processed for user `d6268d6bbeb242949ba4aca2e1debde6`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:48.376383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:48.384982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1280/2562] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:20:48 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:51.938041 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:51.938611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:51.938611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:52.016138 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:20:52.017589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:52.224475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1283/2563] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:20:51 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:20:52.272562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:52.282913 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:52.456004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592dcde6-4225-4636-9b94-7621675bb756 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:52.462793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:52.464109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:52.464562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:52.464996 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:52.487616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:52.489650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:52.500867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1281/2564] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:20:52 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:20:53.829294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:20:53.832106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:53.925266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09634abd-e912-4353-858f-174cb1cfb592 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:20:53.929248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a961dc-91e6-4b3b-a242-170a89aa9b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:20:53.929967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a961dc-91e6-4b3b-a242-170a89aa9b17 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:20:53.930238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a961dc-91e6-4b3b-a242-170a89aa9b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:20:53.930501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a961dc-91e6-4b3b-a242-170a89aa9b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:20:53.932715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f5a961dc-91e6-4b3b-a242-170a89aa9b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:20:54.010564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a961dc-91e6-4b3b-a242-170a89aa9b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:20:54.012055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a961dc-91e6-4b3b-a242-170a89aa9b17 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:20:54.030019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1284/2565] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:20:53 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:21:34.554032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:34.719838 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ba82e-42bc-4265-8db8-85ccf1c82e49 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:34.731211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:34.732767 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:34.735103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:34.736775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] PATH_INFO: `/v3/users/c56a50bf7a3342919d989858e4239d87` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:34.739768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56a50bf7a3342919d989858e4239d87)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:34.744056 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:34.851864 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56a50bf7a3342919d989858e4239d87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:34.852685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56a50bf7a3342919d989858e4239d87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:34.861841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56a50bf7a3342919d989858e4239d87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:34.880020 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56a50bf7a3342919d989858e4239d87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:34.899604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56a50bf7a3342919d989858e4239d87'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:34.920025 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:34.921287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:34.921805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:34.926663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1282/2566] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:21:34 2021] DELETE /identity/v3/users/c56a50bf7a3342919d989858e4239d87 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:21:34.947078 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:21:34.950326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:35.064311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1285/2567] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:21:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:21:35.079055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:35.081371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:35.192969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32d080-3767-4656-a9dc-5ea3c3c0b494 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:35.197364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:35.198399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:35.198801 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:35.199234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:35.221697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:35.223978 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:35.235231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1283/2568] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:21:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:21:35.572885 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:35.574442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:35.588507 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e490b3b6-f3af-4b35-a822-48e0d6df8914 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:35.593967 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:35.595317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:35.596449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:35.596449 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] PATH_INFO: `/v3/projects/944e3fb6d9ef45e1a24d3d8c40615a00` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:35.597952 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944e3fb6d9ef45e1a24d3d8c40615a00)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:35.600394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:35.676169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944e3fb6d9ef45e1a24d3d8c40615a00', 'request_id': 'req-cf2883fc-5223-4c4b-be43-74859845dea6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.685622 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944e3fb6d9ef45e1a24d3d8c40615a00', 'request_id': 'req-cf2883fc-5223-4c4b-be43-74859845dea6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.692499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944e3fb6d9ef45e1a24d3d8c40615a00', 'request_id': 'req-cf2883fc-5223-4c4b-be43-74859845dea6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.717209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] The token cache is being invalidate because project 944e3fb6d9ef45e1a24d3d8c40615a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:21:35.717717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.718732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.721096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1286/2569] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:21:35 2021] DELETE /identity/v3/projects/944e3fb6d9ef45e1a24d3d8c40615a00 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:21:35.726349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:35.736848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215cb96-b684-4586-95e0-02716b324a21 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:35.813769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:35.814841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:35.815324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:35.815761 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] PATH_INFO: `/v3/users/f03d6cbb80aa4b2dbf8e2148a3a7447e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:35.817477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03d6cbb80aa4b2dbf8e2148a3a7447e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:35.819511 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:35.873545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03d6cbb80aa4b2dbf8e2148a3a7447e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.874383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03d6cbb80aa4b2dbf8e2148a3a7447e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.883647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03d6cbb80aa4b2dbf8e2148a3a7447e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.903105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03d6cbb80aa4b2dbf8e2148a3a7447e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.917481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-108eae75-248d-4e8a-b6f7-61736e77e806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03d6cbb80aa4b2dbf8e2148a3a7447e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:35.925281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1284/2570] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:21:35 2021] DELETE /identity/v3/users/f03d6cbb80aa4b2dbf8e2148a3a7447e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:21:36.263131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:36.264958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:36.287013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2883fc-5223-4c4b-be43-74859845dea6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:36.351651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:36.352280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.352591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.352864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] PATH_INFO: `/v3/projects/004cbe1fde9049deb6526d1ac73bf596` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.354528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004cbe1fde9049deb6526d1ac73bf596)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:36.356590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:36.410969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004cbe1fde9049deb6526d1ac73bf596', 'request_id': 'req-ff3ab26f-6147-415e-a2da-11f351f734b7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:36.419176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004cbe1fde9049deb6526d1ac73bf596', 'request_id': 'req-ff3ab26f-6147-415e-a2da-11f351f734b7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:36.428052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004cbe1fde9049deb6526d1ac73bf596', 'request_id': 'req-ff3ab26f-6147-415e-a2da-11f351f734b7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:36.447074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] The token cache is being invalidate because project 004cbe1fde9049deb6526d1ac73bf596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:21:36.447397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:36.448164 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ff3ab26f-6147-415e-a2da-11f351f734b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:21:36.449936 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1287/2571] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:21:36 2021] DELETE /identity/v3/projects/004cbe1fde9049deb6526d1ac73bf596 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:21:36.456973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6300-cb50-411e-9716-27c5196ded94 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.457270 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6300-cb50-411e-9716-27c5196ded94 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.457591 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a6300-cb50-411e-9716-27c5196ded94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.477970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-c24a6300-cb50-411e-9716-27c5196ded94 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:21:36.479229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c24a6300-cb50-411e-9716-27c5196ded94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:36.542745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1285/2572] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:21:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:21:36.552570 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b0331-6f4f-46c3-bca6-272a434dfff2 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.553065 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b0331-6f4f-46c3-bca6-272a434dfff2 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.553354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b0331-6f4f-46c3-bca6-272a434dfff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.575910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5e3b0331-6f4f-46c3-bca6-272a434dfff2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:21:36.577176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5e3b0331-6f4f-46c3-bca6-272a434dfff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:36.586474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1288/2573] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:21:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:21:36.590959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a6300-cb50-411e-9716-27c5196ded94 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:36.601022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a6300-cb50-411e-9716-27c5196ded94 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:36.606630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:36.606793 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.607069 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.607615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.608058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:21:36.608345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:36.609991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:36.623414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1286/2574] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:21:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:21:36.628115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b0331-6f4f-46c3-bca6-272a434dfff2 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:36.637392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b0331-6f4f-46c3-bca6-272a434dfff2 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:36.642748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:36.643601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.643879 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.644151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.644874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:36.646876 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:36.678056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1289/2575] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:21:36 2021] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:21:36.682482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:36.695561 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a79df8-c2cc-4ca8-9a8a-b4423360f700 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:36.768643 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:36.769464 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.769647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.769939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.770659 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:36.772670 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:36.794960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1287/2576] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:21:36 2021] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:21:36.800025 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:36.811124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ca5bf-5666-4f91-955b-2eb6c09c986f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:36.817488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:36.818182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.818481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.818738 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.819499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:36.821128 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:36.833251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1290/2577] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:21:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:21:36.837607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:36.851905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d164405-443f-4878-a5af-447acf1527d2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:36.857282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdfcad1-af2d-4c8f-8d6c-b04d0aa902b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:36.857942 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfcad1-af2d-4c8f-8d6c-b04d0aa902b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.858226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfcad1-af2d-4c8f-8d6c-b04d0aa902b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.858493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdfcad1-af2d-4c8f-8d6c-b04d0aa902b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.859406 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfcad1-af2d-4c8f-8d6c-b04d0aa902b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:36.861562 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdfcad1-af2d-4c8f-8d6c-b04d0aa902b4 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:36.875472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1288/2578] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:21:36 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:21:36.880874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:36.891439 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0d6d4-6f4f-4176-b856-f69ba6a64155 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:36.898097 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:36.899009 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.899283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.899560 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] PATH_INFO: `/v3/projects/cd334af14b4e41ec92a7bd475e344ed3/users/d6ad1bf4b7e74265a9b81eedb49be203/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.919231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd334af14b4e41ec92a7bd475e344ed3, user_id=d6ad1bf4b7e74265a9b81eedb49be203, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:36.922198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:36.938236 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1291/2579] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:21:36 2021] PUT /identity/v3/projects/cd334af14b4e41ec92a7bd475e344ed3/users/d6ad1bf4b7e74265a9b81eedb49be203/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:21:36.948781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75bdbb-f551-4097-9144-3de8b00abe8a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:36.949067 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75bdbb-f551-4097-9144-3de8b00abe8a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:36.949340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75bdbb-f551-4097-9144-3de8b00abe8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:36.983909 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bc75bdbb-f551-4097-9144-3de8b00abe8a None None] MFA Rules not processed for user `d6ad1bf4b7e74265a9b81eedb49be203`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:21:36.985168 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bc75bdbb-f551-4097-9144-3de8b00abe8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:37.075568 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1289/2580] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:21:36 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:21:37.081334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:37.154805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00568720-3dfe-431e-8eee-38582f033577 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:37.160746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:37.161253 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.161664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.162004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.163112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:37.165126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:37.196322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1292/2581] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:21:37 2021] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:21:37.201062 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75bdbb-f551-4097-9144-3de8b00abe8a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:37.212216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75bdbb-f551-4097-9144-3de8b00abe8a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:37.268556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:37.269234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.269569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.269849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.270572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:37.272502 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:37.296212 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1290/2582] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:21:37 2021] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:21:37.300602 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:37.310889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d40d8-0fda-4c40-9065-305702619b17 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:37.316111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:37.316790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.317093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.317366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.318162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:37.320486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:37.332436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1293/2583] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:21:37 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:21:37.336734 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:37.354733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f73d88-cefa-4f1d-b41a-0340af0ca3aa admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:37.354733 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:37.355950 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.356664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.357258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] PATH_INFO: `/v3/projects/31f1f0a705c44fbca0558f1e20cb5279/users/06959120bf5a4547bca40615b15876f9/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.374867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f1f0a705c44fbca0558f1e20cb5279, user_id=06959120bf5a4547bca40615b15876f9, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:37.378157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:37.393124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1291/2584] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:21:37 2021] PUT /identity/v3/projects/31f1f0a705c44fbca0558f1e20cb5279/users/06959120bf5a4547bca40615b15876f9/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:21:37.397606 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:37.412344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d8f26-2a2d-4bf2-9606-c153dc0851e5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:37.483292 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848995ea-3017-4088-a2f3-bd05c1245a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:37.483969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848995ea-3017-4088-a2f3-bd05c1245a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.484273 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848995ea-3017-4088-a2f3-bd05c1245a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.484517 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848995ea-3017-4088-a2f3-bd05c1245a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.485264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848995ea-3017-4088-a2f3-bd05c1245a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:37.487380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848995ea-3017-4088-a2f3-bd05c1245a76 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:37.497890 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1294/2585] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:21:37 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:21:37.502095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:37.512720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af414e-a15d-4688-918a-e57ea2b7baa5 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:37.517564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:37.518449 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.518725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.518993 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] PATH_INFO: `/v3/projects/31f1f0a705c44fbca0558f1e20cb5279/users/06959120bf5a4547bca40615b15876f9/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.521029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f1f0a705c44fbca0558f1e20cb5279, user_id=06959120bf5a4547bca40615b15876f9, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:37.523699 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:37.534627 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1292/2586] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:21:37 2021] PUT /identity/v3/projects/31f1f0a705c44fbca0558f1e20cb5279/users/06959120bf5a4547bca40615b15876f9/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:21:37.546832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.547124 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.547402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.581788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] MFA Rules not processed for user `06959120bf5a4547bca40615b15876f9`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:21:37.583498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:37.662639 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1295/2587] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:21:37 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:21:37.673855 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:37.675748 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:37.742246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0026d1-7941-45de-8bf1-03c69886dd96 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:37.748306 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:37.749273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:37.749728 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:37.750109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:37.826426 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:37.829215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:37.852122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1293/2588] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:21:37 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:21:38.952755 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:38.954777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:39.046308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f19e5a-7f03-4bc0-93fc-73db82415588 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:39.052917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3887-bd5f-46b6-aa59-4a9a4b87aab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:39.054101 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3887-bd5f-46b6-aa59-4a9a4b87aab6 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:39.054605 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3887-bd5f-46b6-aa59-4a9a4b87aab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:39.055063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3887-bd5f-46b6-aa59-4a9a4b87aab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:39.058149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4daf3887-bd5f-46b6-aa59-4a9a4b87aab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:21:39.156912 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3887-bd5f-46b6-aa59-4a9a4b87aab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:39.159641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3887-bd5f-46b6-aa59-4a9a4b87aab6 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:39.173789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1296/2589] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:21:38 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:21:43.692555 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:21:43.707022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3418e05-370a-4c4f-adee-2096b6a06819 service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:21:43.717145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:21:43.718074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:21:43.718368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:21:43.718644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:21:43.735650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:21:43.737825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:21:43.777250 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1294/2590] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:21:43 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:00.031527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:00.032088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:00.032088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:00.050299 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] MFA Rules not processed for user `8051d632998f433f88cff6dce1467fd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:00.051513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:00.108974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1297/2591] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:00 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:00.155549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:00.157553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:00.229044 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3338993-015e-4282-9c9b-2fee80bf871e service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:00.233328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:00.234015 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:00.234292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:00.234565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:00.236419 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:00.317416 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:00.319791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:00.331852 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1295/2592] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:00.582855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:00.585475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:00.612371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0a6bc-633b-42ce-b64f-af97a318f7ab None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:00.615031 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:00.616638 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:00.617034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:00.617496 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:00.620362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:00.633723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:00.635201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:00.643847 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1298/2593] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:00 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:22:00.996689 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:00.998694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:01.005156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:01.014870 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d3209-bbd0-4036-ab36-d25f911fff32 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:01.018731 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:01.019396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:01.019681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:01.019951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:01.021842 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:01.036105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:01.038427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:01.049971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1299/2594] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:22:01.071832 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd89fd37-18e6-478b-92f0-bbe615d594bc service glance] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:01.077199 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacbebf-c0a6-4315-bf48-eec5cf46ac6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:01.078078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbebf-c0a6-4315-bf48-eec5cf46ac6b service placement] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:01.078359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbebf-c0a6-4315-bf48-eec5cf46ac6b service placement] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:01.078630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbebf-c0a6-4315-bf48-eec5cf46ac6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:01.080530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3aacbebf-c0a6-4315-bf48-eec5cf46ac6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:01.093908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacbebf-c0a6-4315-bf48-eec5cf46ac6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:01.097691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacbebf-c0a6-4315-bf48-eec5cf46ac6b service placement] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:01.108584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1296/2595] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:14.322277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:14.386272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e843d72-c27f-4012-85db-7d65f3eb38ca service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:14.390838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:14.391693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:14.391992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:14.392262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] PATH_INFO: `/v3/users/d6ad1bf4b7e74265a9b81eedb49be203` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:14.393590 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ad1bf4b7e74265a9b81eedb49be203)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:14.395530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:14.448180 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ad1bf4b7e74265a9b81eedb49be203'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:14.448726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ad1bf4b7e74265a9b81eedb49be203'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:14.455576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ad1bf4b7e74265a9b81eedb49be203'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:14.468657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ad1bf4b7e74265a9b81eedb49be203'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:14.477691 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ad1bf4b7e74265a9b81eedb49be203'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:14.484149 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1300/2596] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:14 2021] DELETE /identity/v3/users/d6ad1bf4b7e74265a9b81eedb49be203 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:14.490955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:14.491481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:14.491580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:14.510865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:14.512070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:14.579021 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1297/2597] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:14.593324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:14.595992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:14.666572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa824e-5371-415c-8267-7124cde8fe15 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:14.671748 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:14.672525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:14.672783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:14.672947 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:14.683283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:14.684733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:14.694188 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1301/2598] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:14.979003 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:14.980770 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:14.994242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c121400-0b9d-4a4a-8adf-9c516e0cf8b7 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:14.999351 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:15.000360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:15.000720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:15.001058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] PATH_INFO: `/v3/projects/cd334af14b4e41ec92a7bd475e344ed3` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:15.002383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd334af14b4e41ec92a7bd475e344ed3)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:15.004382 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:15.053688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd334af14b4e41ec92a7bd475e344ed3', 'request_id': 'req-4882ce35-33db-4572-b700-e5cead1cd480'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.059859 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd334af14b4e41ec92a7bd475e344ed3', 'request_id': 'req-4882ce35-33db-4572-b700-e5cead1cd480'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.065334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd334af14b4e41ec92a7bd475e344ed3', 'request_id': 'req-4882ce35-33db-4572-b700-e5cead1cd480'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.078340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] The token cache is being invalidate because project cd334af14b4e41ec92a7bd475e344ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:15.078620 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.079233 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.080781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1298/2599] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:14 2021] DELETE /identity/v3/projects/cd334af14b4e41ec92a7bd475e344ed3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:15.084734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:15.094559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c430e4-5a7c-48c7-8f31-3765e5b9d85f service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:15.157181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:15.158082 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:15.158724 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:15.158990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] PATH_INFO: `/v3/users/06959120bf5a4547bca40615b15876f9` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:15.160181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06959120bf5a4547bca40615b15876f9)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:15.162123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:15.216935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06959120bf5a4547bca40615b15876f9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.217635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06959120bf5a4547bca40615b15876f9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.224374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06959120bf5a4547bca40615b15876f9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.237767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06959120bf5a4547bca40615b15876f9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.251473 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-56647c6d-bd50-45b2-87b2-417f7e6cf0d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06959120bf5a4547bca40615b15876f9'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.261901 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1302/2600] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:15 2021] DELETE /identity/v3/users/06959120bf5a4547bca40615b15876f9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:15.568877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:15.570444 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:15.584110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882ce35-33db-4572-b700-e5cead1cd480 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:15.646977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:15.647848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:15.648126 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:15.648401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] PATH_INFO: `/v3/projects/31f1f0a705c44fbca0558f1e20cb5279` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:15.649633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f1f0a705c44fbca0558f1e20cb5279)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:15.651703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:15.706132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f1f0a705c44fbca0558f1e20cb5279', 'request_id': 'req-380d4185-4dc8-4350-9bc5-dd3775d36a41'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.712685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f1f0a705c44fbca0558f1e20cb5279', 'request_id': 'req-380d4185-4dc8-4350-9bc5-dd3775d36a41'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.718926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f1f0a705c44fbca0558f1e20cb5279', 'request_id': 'req-380d4185-4dc8-4350-9bc5-dd3775d36a41'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.734182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] The token cache is being invalidate because project 31f1f0a705c44fbca0558f1e20cb5279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:15.734592 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.735333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-380d4185-4dc8-4350-9bc5-dd3775d36a41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:15.736999 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1299/2601] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:15 2021] DELETE /identity/v3/projects/31f1f0a705c44fbca0558f1e20cb5279 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:15.743442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71f4b-e91d-4f74-9ea4-db5abab98539 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:15.744036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71f4b-e91d-4f74-9ea4-db5abab98539 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:15.744036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e71f4b-e91d-4f74-9ea4-db5abab98539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:15.766508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f1e71f4b-e91d-4f74-9ea4-db5abab98539 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:15.767920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f1e71f4b-e91d-4f74-9ea4-db5abab98539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:15.834110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1303/2602] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:15.842851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2204-f10b-4cba-bd01-58fd38467299 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:15.843139 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2204-f10b-4cba-bd01-58fd38467299 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:15.843391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae2204-f10b-4cba-bd01-58fd38467299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:15.866411 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1cae2204-f10b-4cba-bd01-58fd38467299 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:15.867235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1cae2204-f10b-4cba-bd01-58fd38467299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:15.877120 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1300/2603] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:15.881700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71f4b-e91d-4f74-9ea4-db5abab98539 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:15.892616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e71f4b-e91d-4f74-9ea4-db5abab98539 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:15.897834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:15.898542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:15.898822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:15.899071 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:15.899796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:22:15.900100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:15.901960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:15.914923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1304/2604] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:22:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:22:15.919667 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae2204-f10b-4cba-bd01-58fd38467299 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:15.933216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae2204-f10b-4cba-bd01-58fd38467299 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:15.938381 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:15.939050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:15.939328 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:15.939598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:15.940334 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:15.942350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:15.970297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1301/2605] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:22:15 2021] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:15.974455 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:15.984763 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c9e03-5e9b-45f4-81a0-df5b6001796e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.047440 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.047845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.048122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.048406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.048652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.049391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.049786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:16.051428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.077700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1305/2606] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:22:15 2021] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:16.082995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.094706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9767f0-78d0-4abc-9864-1e7ff6001848 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.101540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.102230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.102511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.102779 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.103526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.106287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.115129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360e903-9bd7-4df6-8c26-cb6ffbf55a0d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.120781 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1306/2607] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:16.121903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.122825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.123208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.123636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.126175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:16.126733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.137726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.138576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a3b71-10c0-4752-89c3-022740c13a87 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.140318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.144161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49437be9-94f1-4d19-93fb-f4e3f3965d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.144956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437be9-94f1-4d19-93fb-f4e3f3965d35 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.145332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437be9-94f1-4d19-93fb-f4e3f3965d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.145766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49437be9-94f1-4d19-93fb-f4e3f3965d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.146584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49437be9-94f1-4d19-93fb-f4e3f3965d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.148719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49437be9-94f1-4d19-93fb-f4e3f3965d35 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.151293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1302/2608] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:22:16.161464 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1307/2609] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:16.165527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.192602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b3f2a-8913-4bd1-b6a2-1e6c439cf1d5 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.201331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.202292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.202603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.202876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] PATH_INFO: `/v3/projects/a028dbd331974ef78f34ceaae88ba348/users/37107d4a355a4411be0b6d1549e3492a/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.221479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a028dbd331974ef78f34ceaae88ba348, user_id=37107d4a355a4411be0b6d1549e3492a, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.224184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.245047 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1303/2610] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:16 2021] PUT /identity/v3/projects/a028dbd331974ef78f34ceaae88ba348/users/37107d4a355a4411be0b6d1549e3492a/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:22:16.254822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7380dc4-fdb2-4cb7-9bcf-f2e181f0601f None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.255104 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7380dc4-fdb2-4cb7-9bcf-f2e181f0601f None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.255384 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7380dc4-fdb2-4cb7-9bcf-f2e181f0601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.288698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-c7380dc4-fdb2-4cb7-9bcf-f2e181f0601f None None] MFA Rules not processed for user `37107d4a355a4411be0b6d1549e3492a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:16.289995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c7380dc4-fdb2-4cb7-9bcf-f2e181f0601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:16.358743 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1308/2611] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:16 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:16.364908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.436596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f64414-7615-4e1e-9a93-4af5b1c38648 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.441905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.442561 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.442834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.443106 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.443812 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.445731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.475050 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1304/2612] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:22:16 2021] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:16.479505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7380dc4-fdb2-4cb7-9bcf-f2e181f0601f None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.491372 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7380dc4-fdb2-4cb7-9bcf-f2e181f0601f None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.554040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.554707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.554984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.555251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.555961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.557930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.583120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1309/2613] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:22:16 2021] POST /identity/v3/users => generated 302 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:22:16.590441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.604596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dcbe2-e21d-4dd0-86e9-4ae126bcba8e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.613804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.614750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.615101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.615460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.616289 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.618806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.631751 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1305/2614] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:16.637630 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.648934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb29a3-072e-4df8-8c63-e60308368041 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.654744 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.655633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.656229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.656370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] PATH_INFO: `/v3/projects/8c5574c25ce844588d047d8ff03ffce9/users/d81622f67c3c46ae90736ca379ab8d63/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.675317 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5574c25ce844588d047d8ff03ffce9, user_id=d81622f67c3c46ae90736ca379ab8d63, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.678171 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.693857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1310/2615] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:16 2021] PUT /identity/v3/projects/8c5574c25ce844588d047d8ff03ffce9/users/d81622f67c3c46ae90736ca379ab8d63/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:16.698609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.708902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d2224-e9b7-4434-aa8e-a348933f92a8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.768885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c27b-fffd-40ea-9997-77d0fd02743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.769557 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c27b-fffd-40ea-9997-77d0fd02743d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.769861 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c27b-fffd-40ea-9997-77d0fd02743d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.770134 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c27b-fffd-40ea-9997-77d0fd02743d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.770877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7c27b-fffd-40ea-9997-77d0fd02743d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.772517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7c27b-fffd-40ea-9997-77d0fd02743d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.782527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1306/2616] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:22:16.787613 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.798103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc543d5-29b3-4817-a7a4-1bcfbff9ce87 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:16.802934 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:16.803793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.804069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.804345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] PATH_INFO: `/v3/projects/8c5574c25ce844588d047d8ff03ffce9/users/d81622f67c3c46ae90736ca379ab8d63/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.806786 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5574c25ce844588d047d8ff03ffce9, user_id=d81622f67c3c46ae90736ca379ab8d63, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:16.809593 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:16.820690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1311/2617] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:16 2021] PUT /identity/v3/projects/8c5574c25ce844588d047d8ff03ffce9/users/d81622f67c3c46ae90736ca379ab8d63/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:16.833027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:16.833312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:16.833613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:16.862263 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] MFA Rules not processed for user `d81622f67c3c46ae90736ca379ab8d63`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:16.863493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:16.938228 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1307/2618] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:16 2021] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:16.947700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:16.949992 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:17.008636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6d9e2-5218-48eb-8082-e38f09be8541 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:17.014417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:17.015067 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:17.015339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:17.015610 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:17.026584 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:17.028853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:17.044189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1312/2619] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:16 2021] GET /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:17.104849 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:17.106588 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:17.120956 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523e406-9e92-4a45-bc38-6659d323112f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:17.127804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689681e-80d6-4b4a-9165-bfe23d49072c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:17.128772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689681e-80d6-4b4a-9165-bfe23d49072c service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:17.129245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689681e-80d6-4b4a-9165-bfe23d49072c service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:17.129765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689681e-80d6-4b4a-9165-bfe23d49072c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:17.191226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689681e-80d6-4b4a-9165-bfe23d49072c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:17.192685 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689681e-80d6-4b4a-9165-bfe23d49072c service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:17.202903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1308/2620] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:17 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:20.514956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:20.584095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462599d2-43c8-4ff0-8507-dd8400b34314 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:20.589204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:20.590105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:20.590385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:20.590659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] PATH_INFO: `/v3/users/37107d4a355a4411be0b6d1549e3492a` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:20.592073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37107d4a355a4411be0b6d1549e3492a)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:20.594123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:20.641932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37107d4a355a4411be0b6d1549e3492a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:20.642564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37107d4a355a4411be0b6d1549e3492a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:20.649410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37107d4a355a4411be0b6d1549e3492a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:20.660898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37107d4a355a4411be0b6d1549e3492a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:20.668884 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37107d4a355a4411be0b6d1549e3492a'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:20.675093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1313/2621] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:20 2021] DELETE /identity/v3/users/37107d4a355a4411be0b6d1549e3492a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:20.679695 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:20.680166 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:20.680294 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:20.701239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:20.703014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:20.787623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1309/2622] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:20.798113 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:20.799735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:20.861700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249a11e-1239-4c38-99a6-89c226a228c6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:20.865851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:20.866493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:20.866771 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:20.867034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:20.877017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:20.878508 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:20.888445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1314/2623] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:21.182628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:21.188045 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:21.200629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f9bf3-1601-4fee-9977-812bec488a25 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:21.208273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:21.209143 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:21.209447 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:21.209943 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] PATH_INFO: `/v3/projects/a028dbd331974ef78f34ceaae88ba348` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:21.211560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a028dbd331974ef78f34ceaae88ba348)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:21.213570 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:21.263074 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a028dbd331974ef78f34ceaae88ba348', 'request_id': 'req-82c9072c-b05d-48d6-b91b-e8b20559c0a0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.269207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a028dbd331974ef78f34ceaae88ba348', 'request_id': 'req-82c9072c-b05d-48d6-b91b-e8b20559c0a0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.274660 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a028dbd331974ef78f34ceaae88ba348', 'request_id': 'req-82c9072c-b05d-48d6-b91b-e8b20559c0a0'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.289730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] The token cache is being invalidate because project a028dbd331974ef78f34ceaae88ba348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:21.290011 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.290694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.292274 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1310/2624] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:21 2021] DELETE /identity/v3/projects/a028dbd331974ef78f34ceaae88ba348 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:22:21.296435 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:21.306367 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218147-be62-4ee4-930c-f5afd5998762 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:21.368588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:21.369346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:21.369662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:21.369929 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] PATH_INFO: `/v3/users/d81622f67c3c46ae90736ca379ab8d63` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:21.371156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81622f67c3c46ae90736ca379ab8d63)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:21.373353 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:21.430801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81622f67c3c46ae90736ca379ab8d63'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.431656 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81622f67c3c46ae90736ca379ab8d63'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.439375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81622f67c3c46ae90736ca379ab8d63'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.451657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81622f67c3c46ae90736ca379ab8d63'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.464300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d38ef667-141d-451b-93e5-c304ce953f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81622f67c3c46ae90736ca379ab8d63'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.471694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1315/2625] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:21 2021] DELETE /identity/v3/users/d81622f67c3c46ae90736ca379ab8d63 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:21.744811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:21.746347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:21.765171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9072c-b05d-48d6-b91b-e8b20559c0a0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:21.826103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:21.827687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:21.827987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:21.828249 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] PATH_INFO: `/v3/projects/8c5574c25ce844588d047d8ff03ffce9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:21.830272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5574c25ce844588d047d8ff03ffce9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:21.832182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:21.885947 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5574c25ce844588d047d8ff03ffce9', 'request_id': 'req-7f54dbae-d670-4e09-97a1-ef563b52e026'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.892527 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5574c25ce844588d047d8ff03ffce9', 'request_id': 'req-7f54dbae-d670-4e09-97a1-ef563b52e026'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.899302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5574c25ce844588d047d8ff03ffce9', 'request_id': 'req-7f54dbae-d670-4e09-97a1-ef563b52e026'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.914323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] The token cache is being invalidate because project 8c5574c25ce844588d047d8ff03ffce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:21.914607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.915324 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-7f54dbae-d670-4e09-97a1-ef563b52e026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:21.916908 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1311/2626] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:21 2021] DELETE /identity/v3/projects/8c5574c25ce844588d047d8ff03ffce9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:21.922990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c465fb3-34ca-4fff-a7f1-51f90215643e None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:21.923465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c465fb3-34ca-4fff-a7f1-51f90215643e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:21.923568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c465fb3-34ca-4fff-a7f1-51f90215643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:21.942357 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-1c465fb3-34ca-4fff-a7f1-51f90215643e None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:21.943827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1c465fb3-34ca-4fff-a7f1-51f90215643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:22.011588 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1316/2627] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:22.020971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6912a0-f65a-4a8e-8c14-94b390dbe3e8 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.021255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6912a0-f65a-4a8e-8c14-94b390dbe3e8 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.021707 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6912a0-f65a-4a8e-8c14-94b390dbe3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.044453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8a6912a0-f65a-4a8e-8c14-94b390dbe3e8 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:22.045995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8a6912a0-f65a-4a8e-8c14-94b390dbe3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:22.066335 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1312/2628] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:22.072850 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c465fb3-34ca-4fff-a7f1-51f90215643e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.087680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c465fb3-34ca-4fff-a7f1-51f90215643e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.093801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.094470 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.094745 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.094996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.095741 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:22:22.096029 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.097680 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.110268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1317/2629] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:22:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:22:22.115343 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6912a0-f65a-4a8e-8c14-94b390dbe3e8 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.126434 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6912a0-f65a-4a8e-8c14-94b390dbe3e8 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.131391 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.132084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.132366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.132641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.133353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.135288 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.169525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1313/2630] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:22:22 2021] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:22.174349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.189706 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b310a-30c7-44d4-ab8e-80bee757702f admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.249875 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.250549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.250828 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.251103 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.251810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.253773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.279562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1318/2631] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:22:22 2021] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:22.286473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.299462 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e4c30-7827-4970-b3ed-dba056f6569d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.304081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.304743 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.305024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.305295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.306071 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.307666 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.321776 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1314/2632] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:22.323312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.334086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aeb03-c4f5-4a3f-9283-6847bd70cf31 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.339585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892b4fb-3abd-4440-980a-4858296c5b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.340272 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892b4fb-3abd-4440-980a-4858296c5b74 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.340549 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892b4fb-3abd-4440-980a-4858296c5b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.340818 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892b4fb-3abd-4440-980a-4858296c5b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.341632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892b4fb-3abd-4440-980a-4858296c5b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.343245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892b4fb-3abd-4440-980a-4858296c5b74 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.356668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1319/2633] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:22.361695 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.377552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9cd8f-9c52-4a8b-820b-9c2fe757e27a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.386366 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.387726 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.388145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.388680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] PATH_INFO: `/v3/projects/85935e79e2734a8ba3576ebebe80ac52/users/8dc151d98cd94077bd6c5f9ee544d06f/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.403904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=85935e79e2734a8ba3576ebebe80ac52, user_id=8dc151d98cd94077bd6c5f9ee544d06f, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.406584 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.424261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1315/2634] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:22 2021] PUT /identity/v3/projects/85935e79e2734a8ba3576ebebe80ac52/users/8dc151d98cd94077bd6c5f9ee544d06f/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:22.434764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04cd57-308a-4c4e-ace0-aaea24441623 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.435047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04cd57-308a-4c4e-ace0-aaea24441623 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.435330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04cd57-308a-4c4e-ace0-aaea24441623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.464641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ec04cd57-308a-4c4e-ace0-aaea24441623 None None] MFA Rules not processed for user `8dc151d98cd94077bd6c5f9ee544d06f`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:22.466040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ec04cd57-308a-4c4e-ace0-aaea24441623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:22.530970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1320/2635] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:22 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:22.536209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.602146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf4b9f-3c28-4570-ade4-ce0078c6a17f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.608209 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.608802 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.609088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.609367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.610115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.612032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.642018 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1316/2636] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:22:22 2021] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:22.646214 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04cd57-308a-4c4e-ace0-aaea24441623 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.657995 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04cd57-308a-4c4e-ace0-aaea24441623 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.726707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.727637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.728027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.728396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.729406 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.732401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.759802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1321/2637] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:22:22 2021] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:22.764017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.774615 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43baf9c-6abc-401a-9288-846a0cc9c528 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.780602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.781528 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.782032 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.782508 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.784022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.786637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.797738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1317/2638] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:22 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:22.803111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.813760 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f1b46-d9b8-4e82-a889-93887e09a8e4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.818666 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.819554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.819812 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.820100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] PATH_INFO: `/v3/projects/6336ef1ac19545f4b3960972f0dfec34/users/c88b13f15c104997b5b0ec1491d11072/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.836014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6336ef1ac19545f4b3960972f0dfec34, user_id=c88b13f15c104997b5b0ec1491d11072, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.838702 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.854342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1322/2639] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:22 2021] PUT /identity/v3/projects/6336ef1ac19545f4b3960972f0dfec34/users/c88b13f15c104997b5b0ec1491d11072/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:22.858597 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.868886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02ed05-aa78-407c-914f-dbded894cd8a admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.935179 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b00f3-c309-4308-80d6-5c7faf26664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.936101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b00f3-c309-4308-80d6-5c7faf26664b admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.936412 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b00f3-c309-4308-80d6-5c7faf26664b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.936686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b00f3-c309-4308-80d6-5c7faf26664b admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.937448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b00f3-c309-4308-80d6-5c7faf26664b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.939081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b00f3-c309-4308-80d6-5c7faf26664b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.949247 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1318/2640] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:22 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:22:22.953832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:22.964535 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a908-d467-4f6b-829d-a534c8ce734b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:22.970340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:22.971256 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:22.971561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:22.971855 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] PATH_INFO: `/v3/projects/6336ef1ac19545f4b3960972f0dfec34/users/c88b13f15c104997b5b0ec1491d11072/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:22.974190 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6336ef1ac19545f4b3960972f0dfec34, user_id=c88b13f15c104997b5b0ec1491d11072, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:22.976924 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:22.988401 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1323/2641] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:22 2021] PUT /identity/v3/projects/6336ef1ac19545f4b3960972f0dfec34/users/c88b13f15c104997b5b0ec1491d11072/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:23.000923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204998b6-a489-4abc-8f1b-2325710c7bbe None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:23.001196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204998b6-a489-4abc-8f1b-2325710c7bbe None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:23.001577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204998b6-a489-4abc-8f1b-2325710c7bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:23.030736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-204998b6-a489-4abc-8f1b-2325710c7bbe None None] MFA Rules not processed for user `c88b13f15c104997b5b0ec1491d11072`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:23.031979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-204998b6-a489-4abc-8f1b-2325710c7bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:23.107531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1319/2642] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:22 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:23.118417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:23.120238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:23.179489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3ae89-2e41-43fa-b495-8e69c2ca9297 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:23.183263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:23.183970 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:23.184246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:23.184500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:23.194192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:23.195633 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:23.205193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1324/2643] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:23 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:23.298697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204998b6-a489-4abc-8f1b-2325710c7bbe None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:23.308995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204998b6-a489-4abc-8f1b-2325710c7bbe None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:23.316033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ed514-a740-4c03-8e22-d3563c849234 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:23.316664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ed514-a740-4c03-8e22-d3563c849234 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:23.316939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ed514-a740-4c03-8e22-d3563c849234 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:23.317213 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ed514-a740-4c03-8e22-d3563c849234 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:23.378084 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ed514-a740-4c03-8e22-d3563c849234 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:23.379539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ed514-a740-4c03-8e22-d3563c849234 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:23.388781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1320/2644] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:23 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:25.993322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:26.067667 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff4b11-db5e-43a8-9837-26bf2140b717 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:26.072669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:26.073583 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:26.073853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:26.074144 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] PATH_INFO: `/v3/users/8dc151d98cd94077bd6c5f9ee544d06f` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:26.075385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc151d98cd94077bd6c5f9ee544d06f)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:26.077304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:26.126990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc151d98cd94077bd6c5f9ee544d06f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.127576 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc151d98cd94077bd6c5f9ee544d06f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.135555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc151d98cd94077bd6c5f9ee544d06f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.148380 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc151d98cd94077bd6c5f9ee544d06f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.157069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc151d98cd94077bd6c5f9ee544d06f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.163495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1325/2645] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:25 2021] DELETE /identity/v3/users/8dc151d98cd94077bd6c5f9ee544d06f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:26.168043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:26.168535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:26.168823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:26.195239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:26.196822 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:26.258526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1321/2646] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:26.268749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:26.270350 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:26.332774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df271b-67ae-46a1-97f0-13927850f471 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:26.345766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:26.345766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:26.345766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:26.345766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:26.348669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:26.350154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:26.360259 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1326/2647] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:22:26.638583 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:26.640241 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:26.652232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e4504-0b9f-4da0-ae73-bea6c27d2deb None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:26.657088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:26.658146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:26.658808 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:26.659052 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] PATH_INFO: `/v3/projects/85935e79e2734a8ba3576ebebe80ac52` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:26.660401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85935e79e2734a8ba3576ebebe80ac52)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:26.662363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:26.710955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85935e79e2734a8ba3576ebebe80ac52', 'request_id': 'req-9325b670-304a-4444-8310-1f63edab1d48'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.717578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85935e79e2734a8ba3576ebebe80ac52', 'request_id': 'req-9325b670-304a-4444-8310-1f63edab1d48'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.723312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85935e79e2734a8ba3576ebebe80ac52', 'request_id': 'req-9325b670-304a-4444-8310-1f63edab1d48'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.737668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] The token cache is being invalidate because project 85935e79e2734a8ba3576ebebe80ac52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:26.737955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.738593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.740579 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1322/2648] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:26 2021] DELETE /identity/v3/projects/85935e79e2734a8ba3576ebebe80ac52 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:26.744513 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:26.754785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e9942-4dfa-4209-b1bf-785d1ada463b service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:26.811895 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:26.812765 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:26.813069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:26.813340 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] PATH_INFO: `/v3/users/c88b13f15c104997b5b0ec1491d11072` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:26.814708 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88b13f15c104997b5b0ec1491d11072)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:26.816625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:26.865157 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88b13f15c104997b5b0ec1491d11072'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.865814 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88b13f15c104997b5b0ec1491d11072'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.872671 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88b13f15c104997b5b0ec1491d11072'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.885844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88b13f15c104997b5b0ec1491d11072'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.895964 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cae3c4ac-13c5-4b4a-b19c-eca06a634965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88b13f15c104997b5b0ec1491d11072'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:26.902729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1327/2649] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:26 2021] DELETE /identity/v3/users/c88b13f15c104997b5b0ec1491d11072 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:27.182380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.183979 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:27.197720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325b670-304a-4444-8310-1f63edab1d48 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:27.266095 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:27.267098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.267293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.267629 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] PATH_INFO: `/v3/projects/6336ef1ac19545f4b3960972f0dfec34` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.268891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6336ef1ac19545f4b3960972f0dfec34)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:27.270897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:27.321890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6336ef1ac19545f4b3960972f0dfec34', 'request_id': 'req-23968f6f-ad85-4ba2-88e2-d3971c6d4553'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:27.329114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6336ef1ac19545f4b3960972f0dfec34', 'request_id': 'req-23968f6f-ad85-4ba2-88e2-d3971c6d4553'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:27.335854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6336ef1ac19545f4b3960972f0dfec34', 'request_id': 'req-23968f6f-ad85-4ba2-88e2-d3971c6d4553'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:27.352221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] The token cache is being invalidate because project 6336ef1ac19545f4b3960972f0dfec34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:27.352575 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:27.353268 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23968f6f-ad85-4ba2-88e2-d3971c6d4553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:27.354920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1323/2650] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:27 2021] DELETE /identity/v3/projects/6336ef1ac19545f4b3960972f0dfec34 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:27.360862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e61f-8e7b-41c5-834b-bfcaabfd5890 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.361393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e61f-8e7b-41c5-834b-bfcaabfd5890 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.361544 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14e61f-8e7b-41c5-834b-bfcaabfd5890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.383733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ea14e61f-8e7b-41c5-834b-bfcaabfd5890 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:27.384950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ea14e61f-8e7b-41c5-834b-bfcaabfd5890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:27.449896 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1328/2651] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:27.459203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7758-980c-45d1-bb8d-0b497244bc4d None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.459507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7758-980c-45d1-bb8d-0b497244bc4d None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.459848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7758-980c-45d1-bb8d-0b497244bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.489388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-da6e7758-980c-45d1-bb8d-0b497244bc4d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:27.490646 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-da6e7758-980c-45d1-bb8d-0b497244bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:27.500136 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1324/2652] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:27.504856 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14e61f-8e7b-41c5-834b-bfcaabfd5890 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.515088 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14e61f-8e7b-41c5-834b-bfcaabfd5890 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:27.521246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:27.522022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.522296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.522559 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.523365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:22:27.523692 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:27.525318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:27.538059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1329/2653] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:22:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:22:27.542563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e7758-980c-45d1-bb8d-0b497244bc4d None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.552284 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e7758-980c-45d1-bb8d-0b497244bc4d None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:27.558033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:27.558692 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.558969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.559244 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.560010 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:27.561967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:27.593881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1325/2654] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:22:27 2021] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:27.598623 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.609178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aecc8-a61c-4203-8180-b3cb5a5a350c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:27.680452 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:27.681022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.681300 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.681617 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.682335 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:27.684283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:27.708224 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1330/2655] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:22:27 2021] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:27.712554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.723079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3140e7-9bbd-4d67-8c76-49c4d32b6d4e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:27.727954 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:27.728611 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.728890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.729160 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.729944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:27.731574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:27.743101 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1326/2656] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:27.747431 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.758354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b55a35-5b6b-426b-bcf8-3cd6cb85528a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:27.764263 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50803f1-5b77-444a-a7b0-3fb08df01558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:27.764953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50803f1-5b77-444a-a7b0-3fb08df01558 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.765226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50803f1-5b77-444a-a7b0-3fb08df01558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.765530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50803f1-5b77-444a-a7b0-3fb08df01558 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.766294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50803f1-5b77-444a-a7b0-3fb08df01558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:27.768115 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50803f1-5b77-444a-a7b0-3fb08df01558 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:27.778529 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1331/2657] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:27.782786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.793962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4053e66-121f-4bcd-b1b2-1292de469aa1 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:27.799694 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:27.800580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.800871 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.801149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] PATH_INFO: `/v3/projects/860c6370cf9e4b0a9073def1b3e9c8d4/users/1ebf22e77ce5480da529754b009e0723/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.816400 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860c6370cf9e4b0a9073def1b3e9c8d4, user_id=1ebf22e77ce5480da529754b009e0723, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:27.819109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:27.835455 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1327/2658] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:27 2021] PUT /identity/v3/projects/860c6370cf9e4b0a9073def1b3e9c8d4/users/1ebf22e77ce5480da529754b009e0723/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:27.840730 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cac8-64b4-4ebb-81b1-2fe06e83490c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:27.841021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cac8-64b4-4ebb-81b1-2fe06e83490c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:27.841297 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cac8-64b4-4ebb-81b1-2fe06e83490c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:27.860225 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ae29cac8-64b4-4ebb-81b1-2fe06e83490c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:27.861572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ae29cac8-64b4-4ebb-81b1-2fe06e83490c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:27.928756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1332/2659] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:22:27.940746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:27.942616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:28.001060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9842cf-ca3c-4ca3-b6f6-77c3b78b4462 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:28.006895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:28.007581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:28.007866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:28.008142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:28.019519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:28.020969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:28.031293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1328/2660] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:28.699287 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbedf65-7f1b-46cd-b2fb-31b3a84b1f87 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:28.700155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbedf65-7f1b-46cd-b2fb-31b3a84b1f87 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:28.700564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbedf65-7f1b-46cd-b2fb-31b3a84b1f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:28.728930 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-0dbedf65-7f1b-46cd-b2fb-31b3a84b1f87 None None] MFA Rules not processed for user `1ebf22e77ce5480da529754b009e0723`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:28.730548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-0dbedf65-7f1b-46cd-b2fb-31b3a84b1f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:28.798909 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1333/2661] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:28.803571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:28.816472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721f16c-5dae-413f-8ee8-16d97a08d560 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:28.822362 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:28.823046 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:28.823340 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:28.823622 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:28.824350 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:28.826668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:28.857450 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1329/2662] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:22:28 2021] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:28.861603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbedf65-7f1b-46cd-b2fb-31b3a84b1f87 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:28.872962 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbedf65-7f1b-46cd-b2fb-31b3a84b1f87 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:28.928460 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:28.929169 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:28.929487 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:28.929790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:28.930510 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:28.932453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:28.957953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1334/2663] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:22:28 2021] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:22:28.959210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:28.969390 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccf9a6-d093-41f9-85b1-361508905157 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:28.976870 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:28.977911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:28.978257 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:28.978645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:28.979860 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:28.984273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:28.994586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1330/2664] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:28 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:22:29.000069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:29.014754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d052c4-b357-4c09-bf15-919b132952b8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:29.020649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:29.021555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:29.021834 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:29.022111 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] PATH_INFO: `/v3/projects/3a88961c6f1b424db2d0e6211c7a405c/users/c7d785ebc9194645a2f4bb972a407ed6/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:29.039125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a88961c6f1b424db2d0e6211c7a405c, user_id=c7d785ebc9194645a2f4bb972a407ed6, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:29.041857 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:29.057012 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1335/2665] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:28 2021] PUT /identity/v3/projects/3a88961c6f1b424db2d0e6211c7a405c/users/c7d785ebc9194645a2f4bb972a407ed6/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:29.061167 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:29.072969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abbe93-f47e-48bb-97eb-3289c2edfbfb admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:29.134272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619a62f-0240-4930-b51a-9d1a5142a3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:29.135488 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a62f-0240-4930-b51a-9d1a5142a3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:29.135889 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a62f-0240-4930-b51a-9d1a5142a3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:29.136239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619a62f-0240-4930-b51a-9d1a5142a3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:29.137357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a62f-0240-4930-b51a-9d1a5142a3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:29.139912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619a62f-0240-4930-b51a-9d1a5142a3cb admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:29.155713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1331/2666] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:29 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:22:29.161073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:29.171255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff319194-d265-4a0f-9ccd-8e109eb72aef admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:29.176402 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:29.177269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:29.177594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:29.177868 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] PATH_INFO: `/v3/projects/3a88961c6f1b424db2d0e6211c7a405c/users/c7d785ebc9194645a2f4bb972a407ed6/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:29.179882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a88961c6f1b424db2d0e6211c7a405c, user_id=c7d785ebc9194645a2f4bb972a407ed6, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:29.182537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:29.196910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1336/2667] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:29 2021] PUT /identity/v3/projects/3a88961c6f1b424db2d0e6211c7a405c/users/c7d785ebc9194645a2f4bb972a407ed6/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:29.843696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f94d3-81ca-4c14-8dba-9e59454d5eae None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:29.844272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f94d3-81ca-4c14-8dba-9e59454d5eae None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:29.844272 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f94d3-81ca-4c14-8dba-9e59454d5eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:29.873948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-491f94d3-81ca-4c14-8dba-9e59454d5eae None None] MFA Rules not processed for user `c7d785ebc9194645a2f4bb972a407ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:29.875423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-491f94d3-81ca-4c14-8dba-9e59454d5eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:29.960836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1332/2668] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:29 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:29.972126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:29.974148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:30.045732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1f4db-555c-4ace-b4ef-25edce63163e admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:30.050572 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:30.051229 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:30.051530 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:30.051759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:30.113522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:30.114989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:30.124315 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1337/2669] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:29 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:31.508664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f94d3-81ca-4c14-8dba-9e59454d5eae None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:31.519509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f94d3-81ca-4c14-8dba-9e59454d5eae None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:31.524094 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:31.524741 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:31.525016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:31.525283 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:31.536573 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:31.538092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:31.549887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1333/2670] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:31 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:42.223325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:42.225205 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:42.306788 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe0980-03c1-4b74-8814-42e601f60af5 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:42.312971 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:42.313670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:42.313955 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:42.314232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:42.316068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:42.329695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:42.331329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:42.342742 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1338/2671] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:46.793208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:46.862587 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4939f0-3c57-4ef7-9fa5-ede9ac8d9f6e service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:46.868195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:46.869211 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:46.869540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:46.869813 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] PATH_INFO: `/v3/users/1ebf22e77ce5480da529754b009e0723` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:46.871180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebf22e77ce5480da529754b009e0723)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:46.873183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:46.920843 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebf22e77ce5480da529754b009e0723'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:46.921409 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebf22e77ce5480da529754b009e0723'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:46.928635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebf22e77ce5480da529754b009e0723'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:46.941851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebf22e77ce5480da529754b009e0723'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:46.951150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebf22e77ce5480da529754b009e0723'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:46.957357 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1334/2672] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:46 2021] DELETE /identity/v3/users/1ebf22e77ce5480da529754b009e0723 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:47.139443 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:47.152989 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7535701-701e-47fd-8ca5-6a6f2fd397ee service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:47.217664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:47.218562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:47.218843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:47.219121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] PATH_INFO: `/v3/projects/860c6370cf9e4b0a9073def1b3e9c8d4` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:47.220422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=860c6370cf9e4b0a9073def1b3e9c8d4)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:47.223150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:47.277795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860c6370cf9e4b0a9073def1b3e9c8d4', 'request_id': 'req-d55d5fb0-ab2f-41f0-a14e-b573906476aa'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.284865 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860c6370cf9e4b0a9073def1b3e9c8d4', 'request_id': 'req-d55d5fb0-ab2f-41f0-a14e-b573906476aa'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.291599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860c6370cf9e4b0a9073def1b3e9c8d4', 'request_id': 'req-d55d5fb0-ab2f-41f0-a14e-b573906476aa'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.304990 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] The token cache is being invalidate because project 860c6370cf9e4b0a9073def1b3e9c8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:47.305284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.305951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.307541 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1339/2673] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:47 2021] DELETE /identity/v3/projects/860c6370cf9e4b0a9073def1b3e9c8d4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:47.311580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:47.313103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:47.326204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d3860-4eaf-41d3-ac32-00a6000a2280 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:47.391944 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:47.392842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:47.393119 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:47.393371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] PATH_INFO: `/v3/users/c7d785ebc9194645a2f4bb972a407ed6` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:47.394649 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d785ebc9194645a2f4bb972a407ed6)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:47.396580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:47.445758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d785ebc9194645a2f4bb972a407ed6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.446448 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d785ebc9194645a2f4bb972a407ed6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.453262 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d785ebc9194645a2f4bb972a407ed6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.465180 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d785ebc9194645a2f4bb972a407ed6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.472970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-96400a1a-6f76-4581-a152-dbf029967022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d785ebc9194645a2f4bb972a407ed6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.479146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1335/2674] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:22:47 2021] DELETE /identity/v3/users/c7d785ebc9194645a2f4bb972a407ed6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:47.682375 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:47.684046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:47.698878 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d5fb0-ab2f-41f0-a14e-b573906476aa admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:47.769762 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:47.771077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:47.771429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:47.771564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] PATH_INFO: `/v3/projects/3a88961c6f1b424db2d0e6211c7a405c` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:47.773495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a88961c6f1b424db2d0e6211c7a405c)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:47.775425 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:47.830313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a88961c6f1b424db2d0e6211c7a405c', 'request_id': 'req-b8667ccb-9408-493c-9863-5355afb58d4c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.837804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a88961c6f1b424db2d0e6211c7a405c', 'request_id': 'req-b8667ccb-9408-493c-9863-5355afb58d4c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.843994 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a88961c6f1b424db2d0e6211c7a405c', 'request_id': 'req-b8667ccb-9408-493c-9863-5355afb58d4c'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.857074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] The token cache is being invalidate because project 3a88961c6f1b424db2d0e6211c7a405c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:22:47.857379 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.858032 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b8667ccb-9408-493c-9863-5355afb58d4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:22:47.859632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1340/2675] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:22:47 2021] DELETE /identity/v3/projects/3a88961c6f1b424db2d0e6211c7a405c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:47.867498 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe1be9-f426-426a-88b0-af193fd50faa None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:47.867994 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe1be9-f426-426a-88b0-af193fd50faa None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:47.868114 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe1be9-f426-426a-88b0-af193fd50faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:47.892746 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7dfe1be9-f426-426a-88b0-af193fd50faa None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:47.894432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7dfe1be9-f426-426a-88b0-af193fd50faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:47.957952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1336/2676] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:22:47.966179 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388263f-1246-43c8-9847-0edb02be12ba None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:47.966468 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388263f-1246-43c8-9847-0edb02be12ba None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:47.966747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388263f-1246-43c8-9847-0edb02be12ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:47.987275 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-3388263f-1246-43c8-9847-0edb02be12ba None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:47.988486 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-3388263f-1246-43c8-9847-0edb02be12ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:47.998693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1341/2677] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:48.003839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe1be9-f426-426a-88b0-af193fd50faa None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:48.015051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe1be9-f426-426a-88b0-af193fd50faa None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:48.024760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:48.025309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.025650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.025930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.026688 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79350) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:22:48.026995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:48.028647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:48.043517 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1337/2678] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:22:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:22:48.050016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388263f-1246-43c8-9847-0edb02be12ba None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:48.064034 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388263f-1246-43c8-9847-0edb02be12ba None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:48.071561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:48.072218 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.072493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.072756 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.073472 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:48.075417 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:48.106298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1342/2679] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:22:48 2021] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:48.110769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:48.121932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a145db9d-9db3-4ca2-97c4-158906ac6c40 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:48.189280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:48.190002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.190292 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.190553 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.191275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:48.193223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:48.215608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1338/2680] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:22:48 2021] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:22:48.219839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:48.231371 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e0670-193d-4bc5-ac73-79e7d3d4aec5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:48.236133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:48.236799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.237080 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.237365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.238135 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:48.239780 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:48.255821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1343/2681] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:48.261631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:48.276318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8598f36-36ca-4259-9d92-7df1fd9e692c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:48.282645 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab1d73-59ed-4759-8157-f934ac54481d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:48.283655 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab1d73-59ed-4759-8157-f934ac54481d admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.283954 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab1d73-59ed-4759-8157-f934ac54481d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.284226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab1d73-59ed-4759-8157-f934ac54481d admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.284987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab1d73-59ed-4759-8157-f934ac54481d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:48.286641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab1d73-59ed-4759-8157-f934ac54481d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:48.297373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1339/2682] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:22:48 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:22:48.301802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:48.313140 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a0dd9-a3b0-4c86-9232-21caa40bbcdc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:48.319154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:48.320171 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.320448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.320718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] PATH_INFO: `/v3/projects/9e7e90df19c94742bc534164c49e5101/users/7ed8c4ae59f341ea92e28f3c68731fe2/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.337686 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7e90df19c94742bc534164c49e5101, user_id=7ed8c4ae59f341ea92e28f3c68731fe2, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:48.340339 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:48.358595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1344/2683] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:22:48 2021] PUT /identity/v3/projects/9e7e90df19c94742bc534164c49e5101/users/7ed8c4ae59f341ea92e28f3c68731fe2/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:22:48.372910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.373170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.373460 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.402246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] MFA Rules not processed for user `7ed8c4ae59f341ea92e28f3c68731fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:48.403469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:48.479356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1340/2684] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:22:48 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:48.492096 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:48.493732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:48.553344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88452dc-1e88-448d-bbb5-fbea1fee1ce7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:48.558334 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86fbb9-61af-4f68-be1e-3ac20ca37a5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:48.558996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86fbb9-61af-4f68-be1e-3ac20ca37a5a service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:48.559271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86fbb9-61af-4f68-be1e-3ac20ca37a5a service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:48.559538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86fbb9-61af-4f68-be1e-3ac20ca37a5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:48.570629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86fbb9-61af-4f68-be1e-3ac20ca37a5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:48.572004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86fbb9-61af-4f68-be1e-3ac20ca37a5a service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:48.581789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1345/2685] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:48 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:58.577785 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:58.580299 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:58.665732 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee0be9-ce64-47a3-b623-2749da593b61 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:58.673388 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:58.674112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:58.674364 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:58.674636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:58.676882 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:58.690697 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:58.692295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:58.703370 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1341/2686] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:22:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:22:58.918221 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:58.918782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:58.918882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:58.938805 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:22:58.940068 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:59.006046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1346/2687] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:22:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:22:59.050251 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:22:59.052066 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:22:59.132824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c881050-ad26-44f7-8607-5c653112f2d1 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:22:59.138925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:22:59.139820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:22:59.140106 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:22:59.140385 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:22:59.149738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:22:59.151355 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:22:59.161281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1342/2688] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:22:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:23:07.885462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:07.887285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:07.997204 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd7181-1063-4b3e-aee7-27479d433033 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:08.006664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:08.007021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:08.007331 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:08.007725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] PATH_INFO: `/v3/users/8051d632998f433f88cff6dce1467fd7` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:08.012095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8051d632998f433f88cff6dce1467fd7)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:08.017161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:08.092349 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8051d632998f433f88cff6dce1467fd7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.093022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8051d632998f433f88cff6dce1467fd7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.106953 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8051d632998f433f88cff6dce1467fd7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.117681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8051d632998f433f88cff6dce1467fd7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.143550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-ee7f0a82-d134-40f2-9ba1-3994d9c90ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8051d632998f433f88cff6dce1467fd7'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.161074 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1347/2689] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:23:07 2021] DELETE /identity/v3/users/8051d632998f433f88cff6dce1467fd7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:23:08.391267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:08.406820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd82a2-3b96-4dfc-b6b6-b7a31999d009 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:08.493903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:08.494844 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:08.495132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:08.495413 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] PATH_INFO: `/v3/projects/ec26dd4c49f74ef7b1b41c9d379e7aa6` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:08.497034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec26dd4c49f74ef7b1b41c9d379e7aa6)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:08.499108 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:08.563848 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec26dd4c49f74ef7b1b41c9d379e7aa6', 'request_id': 'req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.573325 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec26dd4c49f74ef7b1b41c9d379e7aa6', 'request_id': 'req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.580927 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec26dd4c49f74ef7b1b41c9d379e7aa6', 'request_id': 'req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.595125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] The token cache is being invalidate because project ec26dd4c49f74ef7b1b41c9d379e7aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:23:08.595410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.596712 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-23d76117-1b8d-4f1f-83dd-cdb903bafc9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:08.598576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1343/2690] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:23:08 2021] DELETE /identity/v3/projects/ec26dd4c49f74ef7b1b41c9d379e7aa6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:23:08.606105 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1c53f-2925-4fdc-8c44-37a070d18a3d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:08.606386 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1c53f-2925-4fdc-8c44-37a070d18a3d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:08.606658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1c53f-2925-4fdc-8c44-37a070d18a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:08.626515 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-dcd1c53f-2925-4fdc-8c44-37a070d18a3d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:08.627793 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-dcd1c53f-2925-4fdc-8c44-37a070d18a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:08.701630 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1348/2691] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:08.710317 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c20e7-5a91-4494-95c0-58fd31f940a3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:08.710644 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c20e7-5a91-4494-95c0-58fd31f940a3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:08.710915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c20e7-5a91-4494-95c0-58fd31f940a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:08.731173 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-496c20e7-5a91-4494-95c0-58fd31f940a3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:08.732590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-496c20e7-5a91-4494-95c0-58fd31f940a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:08.741576 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1344/2692] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:08.746915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1c53f-2925-4fdc-8c44-37a070d18a3d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:08.762463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1c53f-2925-4fdc-8c44-37a070d18a3d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:08.770198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:08.771238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:08.771727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:08.772187 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:08.773618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:23:08.774161 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:08.777366 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:08.791139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1349/2693] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:23:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:23:08.797002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c20e7-5a91-4494-95c0-58fd31f940a3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:08.807221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c20e7-5a91-4494-95c0-58fd31f940a3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:08.813998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:08.815048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:08.815503 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:08.815846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:08.816911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:08.820176 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:08.856867 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1345/2694] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:23:08 2021] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:23:08.861220 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:08.873252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72995bc4-0891-4fa2-b070-db213defa2ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:08.949168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:08.949918 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:08.950037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:08.950304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:08.951244 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:08.953726 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:08.980488 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1350/2695] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:23:08 2021] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:23:08.986302 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:08.998133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0fdb5-27e9-4f2a-95ea-4f788d05c929 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:09.004521 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:09.005226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:09.005543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:09.005821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:09.006586 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:09.008246 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:09.020554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1346/2696] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:23:08 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:23:09.024904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:09.041642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce804c64-757c-45db-866d-2e7b50fd1339 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:09.046941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ca594a-b7f0-444d-85f2-d0707bcfc5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:09.047641 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca594a-b7f0-444d-85f2-d0707bcfc5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:09.047913 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca594a-b7f0-444d-85f2-d0707bcfc5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:09.048191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ca594a-b7f0-444d-85f2-d0707bcfc5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:09.048948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca594a-b7f0-444d-85f2-d0707bcfc5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:09.050637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ca594a-b7f0-444d-85f2-d0707bcfc5d9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:09.061773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1351/2697] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:23:09 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:23:09.066321 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:09.079628 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c187a3a-a157-4b47-a25c-282ddd928889 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:09.086710 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:09.087623 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:09.088009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:09.088311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] PATH_INFO: `/v3/projects/2ea0808579e44cdcaeba4109bc12863b/users/d50a2cbb753943a89b4722852ce191c1/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:09.109500 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea0808579e44cdcaeba4109bc12863b, user_id=d50a2cbb753943a89b4722852ce191c1, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:09.112253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:09.132499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1347/2698] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:23:09 2021] PUT /identity/v3/projects/2ea0808579e44cdcaeba4109bc12863b/users/d50a2cbb753943a89b4722852ce191c1/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:23:09.139831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:09.140308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:09.140808 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:09.172669 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:09.175047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:09.299413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1352/2699] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:09.313349 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:09.317017 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:09.410554 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f76e-0db8-425f-91c0-a9d300a776a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:09.414577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed8c90-566a-445d-8e99-c22d38b16038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:09.415368 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8c90-566a-445d-8e99-c22d38b16038 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:09.415752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8c90-566a-445d-8e99-c22d38b16038 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:09.416360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8c90-566a-445d-8e99-c22d38b16038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:09.429973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed8c90-566a-445d-8e99-c22d38b16038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:09.432856 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed8c90-566a-445d-8e99-c22d38b16038 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:09.450399 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1348/2700] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:23:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:23:14.191542 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:14.194129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:14.231640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36264d65-5ba6-4912-84e7-f4df72e5a106 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:14.239238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:14.240751 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:14.241180 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:14.241718 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:14.244777 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:14.262189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:14.264830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:14.277410 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1353/2701] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:23:14 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:23:14.931650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7752-3d06-4c9b-875b-ee4759b2d4ac None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:14.932113 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7752-3d06-4c9b-875b-ee4759b2d4ac None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:14.932216 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c7752-3d06-4c9b-875b-ee4759b2d4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:14.959569 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-506c7752-3d06-4c9b-875b-ee4759b2d4ac None None] MFA Rules not processed for user `d50a2cbb753943a89b4722852ce191c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:14.960791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-506c7752-3d06-4c9b-875b-ee4759b2d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:15.026064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1349/2702] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:14 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:15.030873 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:15.044722 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bf2ef-0f0d-456c-af4e-802284ad02c4 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:15.052998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:15.053705 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.053983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.054251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.054956 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:15.056864 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:15.086126 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1354/2703] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:23:15 2021] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:23:15.090452 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7752-3d06-4c9b-875b-ee4759b2d4ac None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:15.107795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c7752-3d06-4c9b-875b-ee4759b2d4ac None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:15.167939 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:15.168661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.168946 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.169223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] PATH_INFO: `/v3/users` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.170146 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:15.172115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:15.199395 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1350/2704] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:23:15 2021] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:23:15.210648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:15.222616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5e5e3-5253-46de-a033-56b1d36f52c0 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:15.231006 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:15.231852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.235309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.235309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.235309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:15.235795 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:15.248232 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1355/2705] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:23:15 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:23:15.252731 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:15.274220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e204ec-5c46-43ed-9695-be812c36ae05 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:15.288124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:15.288124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.288124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.288124 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] PATH_INFO: `/v3/projects/e8cfa442410048ee8abafea0f22e1fa1/users/e968bc266de0465b8c0013e85b44e2a9/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.305881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cfa442410048ee8abafea0f22e1fa1, user_id=e968bc266de0465b8c0013e85b44e2a9, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:15.308686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:15.329009 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1351/2706] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:23:15 2021] PUT /identity/v3/projects/e8cfa442410048ee8abafea0f22e1fa1/users/e968bc266de0465b8c0013e85b44e2a9/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:23:15.333364 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:15.345533 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a7899-edd9-48e1-9e18-824a366870fc admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:15.442721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599c9ed-9b3a-4f02-9878-a23afc229631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:15.444052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c9ed-9b3a-4f02-9878-a23afc229631 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.444547 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c9ed-9b3a-4f02-9878-a23afc229631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.444983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599c9ed-9b3a-4f02-9878-a23afc229631 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.446586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599c9ed-9b3a-4f02-9878-a23afc229631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:15.450475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599c9ed-9b3a-4f02-9878-a23afc229631 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:15.482564 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:15.492511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1356/2707] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:23:15 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:23:15.502695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93768-e112-460f-849d-b825b0b6cdf1 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.503175 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93768-e112-460f-849d-b825b0b6cdf1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.503703 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c93768-e112-460f-849d-b825b0b6cdf1 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.509293 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1357/2708] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:23:15 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:23:15.516770 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127600d1-37b3-4122-8825-cf7f82e98ee7 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.517274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127600d1-37b3-4122-8825-cf7f82e98ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.517789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127600d1-37b3-4122-8825-cf7f82e98ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.518014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73964e0-2e4c-4011-99c1-0efb16e4136e admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:15.537535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:15.541719 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.542486 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.543259 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] PATH_INFO: `/v3/projects/e8cfa442410048ee8abafea0f22e1fa1/users/e968bc266de0465b8c0013e85b44e2a9/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.548107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8cfa442410048ee8abafea0f22e1fa1, user_id=e968bc266de0465b8c0013e85b44e2a9, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:15.553605 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:15.589823 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1352/2709] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:23:15 2021] PUT /identity/v3/projects/e8cfa442410048ee8abafea0f22e1fa1/users/e968bc266de0465b8c0013e85b44e2a9/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:23:15.601893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-127600d1-37b3-4122-8825-cf7f82e98ee7 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:15.604086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-127600d1-37b3-4122-8825-cf7f82e98ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:15.709526 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1358/2710] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:23:15 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:15.729512 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:15.731865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:15.831932 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46006c3-218d-4dfd-bd3e-1bf34540be3f admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:15.836928 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c4395-c019-4e07-a718-a0475c1e0c58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:15.837915 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c4395-c019-4e07-a718-a0475c1e0c58 service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:15.838359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c4395-c019-4e07-a718-a0475c1e0c58 service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:15.838663 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c4395-c019-4e07-a718-a0475c1e0c58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:15.853941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c4395-c019-4e07-a718-a0475c1e0c58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:15.855652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c4395-c019-4e07-a718-a0475c1e0c58 service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:15.873984 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1353/2711] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:23:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:23:16.018117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e9ba3-170f-4a96-a43a-7e6878025af9 None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:16.018396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e9ba3-170f-4a96-a43a-7e6878025af9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:16.018565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e9ba3-170f-4a96-a43a-7e6878025af9 None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:16.020794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1359/2712] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:23:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:23:16.040002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:16.041940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:16.043420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:16.077219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] MFA Rules not processed for user `6d09511f0bb7411f9f8c06f49d3a5810`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:16.078791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:16.177636 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1354/2713] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:23:16 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:16.196717 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e9ba3-170f-4a96-a43a-7e6878025af9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:16.211209 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e9ba3-170f-4a96-a43a-7e6878025af9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:16.215600 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee7128-12ad-4748-9cb8-3deb80c02da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:16.216681 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee7128-12ad-4748-9cb8-3deb80c02da5 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:16.217240 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee7128-12ad-4748-9cb8-3deb80c02da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:16.217739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee7128-12ad-4748-9cb8-3deb80c02da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:16.229385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee7128-12ad-4748-9cb8-3deb80c02da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:16.231266 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee7128-12ad-4748-9cb8-3deb80c02da5 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:16.242176 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1360/2714] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:23:16 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:23:21.604053 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:21.605749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:21.710226 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c9ac0-af6f-494d-88cd-149ce7b34bc6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:21.723359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:21.724277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:21.724557 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:21.729039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:21.730034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:21.730315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:21.730590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] PATH_INFO: `/v3/users/7ed8c4ae59f341ea92e28f3c68731fe2` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:21.732484 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed8c4ae59f341ea92e28f3c68731fe2)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:21.734624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:21.759454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] MFA Rules not processed for user `e968bc266de0465b8c0013e85b44e2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:21.760723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:21.803033 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed8c4ae59f341ea92e28f3c68731fe2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:21.804090 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed8c4ae59f341ea92e28f3c68731fe2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:21.818641 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed8c4ae59f341ea92e28f3c68731fe2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:21.834806 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed8c4ae59f341ea92e28f3c68731fe2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:21.846339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-52321520-559d-445a-a6f4-419b7ea6962a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed8c4ae59f341ea92e28f3c68731fe2'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:21.859853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1355/2715] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:23:21 2021] DELETE /identity/v3/users/7ed8c4ae59f341ea92e28f3c68731fe2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:23:21.867367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:21.867925 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:21.868356 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:21.880116 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1361/2716] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:21 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:23:21.894122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:21.898192 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:21.903952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:21.905881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:21.936579 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4976dd-881d-4c00-89a5-928816a5e7aa None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:21.979900 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1356/2717] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:23:21.988899 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:21.992720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:22.054254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50075e5a-0883-49b2-ba47-df66f3b8cc55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:22.055238 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50075e5a-0883-49b2-ba47-df66f3b8cc55 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:22.056789 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50075e5a-0883-49b2-ba47-df66f3b8cc55 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:22.057264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50075e5a-0883-49b2-ba47-df66f3b8cc55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:22.060631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-50075e5a-0883-49b2-ba47-df66f3b8cc55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:22.082307 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08087b0-9a15-409d-8062-cc2ee9f622a0 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:22.086815 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:22.087727 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:22.088165 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:22.088650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:22.099798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:22.101280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:22.115549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1357/2718] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:23:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:23:22.169832 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50075e5a-0883-49b2-ba47-df66f3b8cc55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:22.172045 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50075e5a-0883-49b2-ba47-df66f3b8cc55 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:22.184733 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1362/2719] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:23:21 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:23:22.476373 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:22.478967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:22.493621 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6addd-3ac7-4480-98f8-9b33c39bf054 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:22.498972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:22.499845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:22.500269 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:22.500552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] PATH_INFO: `/v3/projects/9e7e90df19c94742bc534164c49e5101` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:22.501895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7e90df19c94742bc534164c49e5101)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:22.503912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:22.596535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7e90df19c94742bc534164c49e5101', 'request_id': 'req-f409f604-cd6f-4849-990f-17f27f57f2c8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:22.607742 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7e90df19c94742bc534164c49e5101', 'request_id': 'req-f409f604-cd6f-4849-990f-17f27f57f2c8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:22.618877 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7e90df19c94742bc534164c49e5101', 'request_id': 'req-f409f604-cd6f-4849-990f-17f27f57f2c8'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:22.640820 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] The token cache is being invalidate because project 9e7e90df19c94742bc534164c49e5101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:23:22.641539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:22.642547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:23:22.645566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1358/2720] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:23:22 2021] DELETE /identity/v3/projects/9e7e90df19c94742bc534164c49e5101 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:23:23.922050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba812ba-cb1b-4562-b559-34b7bf0d4123 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:23.922573 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba812ba-cb1b-4562-b559-34b7bf0d4123 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:23.922817 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba812ba-cb1b-4562-b559-34b7bf0d4123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:23.947184 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-aba812ba-cb1b-4562-b559-34b7bf0d4123 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:23.948413 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-aba812ba-cb1b-4562-b559-34b7bf0d4123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:24.044854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1363/2721] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:23:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:24.060159 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:24.062671 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:24.156998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f409f604-cd6f-4849-990f-17f27f57f2c8 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:24.164480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677fb8-fd61-4059-b518-c4608f0067f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:24.165470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677fb8-fd61-4059-b518-c4608f0067f0 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:24.166002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677fb8-fd61-4059-b518-c4608f0067f0 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:24.166493 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677fb8-fd61-4059-b518-c4608f0067f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:24.187414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5677fb8-fd61-4059-b518-c4608f0067f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:24.189367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5677fb8-fd61-4059-b518-c4608f0067f0 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:24.201520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1359/2722] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:23:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:23:24.810916 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:24.811294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:24.811859 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:24.878665 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] MFA Rules not processed for user `d50a2cbb753943a89b4722852ce191c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:24.889015 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:25.024019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1364/2723] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:36.862798 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534e82-cfbd-4c31-b43e-21c29b026f95 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:36.863397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534e82-cfbd-4c31-b43e-21c29b026f95 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:36.863397 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534e82-cfbd-4c31-b43e-21c29b026f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:36.882129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-bc534e82-cfbd-4c31-b43e-21c29b026f95 None None] MFA Rules not processed for user `d83e82f8ae2e4203b5f0c5d120c58792`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:36.883589 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-bc534e82-cfbd-4c31-b43e-21c29b026f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:36.945612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1360/2724] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:23:36 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:44.600914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:44.603280 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:44.696899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb296c-c018-4337-9602-b1a9725a4443 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:44.703829 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:44.704442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:44.704903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:44.705344 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:44.707245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:44.721601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:44.723394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:44.735424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1365/2725] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:23:44 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:23:47.723885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79119-8533-4f7f-8ac9-3dba6aad72ec None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:47.723885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79119-8533-4f7f-8ac9-3dba6aad72ec None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:47.724544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79119-8533-4f7f-8ac9-3dba6aad72ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:47.747157 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-31b79119-8533-4f7f-8ac9-3dba6aad72ec None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:47.748682 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-31b79119-8533-4f7f-8ac9-3dba6aad72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:47.756473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1361/2726] 10.222.0.31 () {58 vars in 967 bytes} [Tue Nov 16 03:23:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:47.776234 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:47.789319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49155e9-84b0-4e2c-b4a3-1249ab25159d service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:47.796831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:47.797595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:47.798072 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:47.798494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:47.808499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:47.810324 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:47.821774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1366/2727] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:23:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 16 03:23:54.361405 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:54.362161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:54.362161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:54.386600 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:23:54.388797 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:23:54.398654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1362/2728] 10.222.0.31 () {58 vars in 967 bytes} [Tue Nov 16 03:23:54 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:23:54.417381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:23:54.431867 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19404df3-5acc-42d2-81b5-2975cd72c349 service swift] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:23:54.443479 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:23:54.444732 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:23:54.445312 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:23:54.445914 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:23:54.457318 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:23:54.459651 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:23:54.471154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1367/2729] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:23:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:24:01.623640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:24:01.628525 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:24:01.689668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f593a8-0eb2-4367-97b7-245dd03456a6 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:24:01.693545 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:24:01.694208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:24:01.694489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:24:01.694769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:24:01.696775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:24:01.777840 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:24:01.780007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:24:01.790977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1363/2730] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:24:01 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:24:03.602093 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:24:03.603612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:24:03.671640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e28bf-9bfb-4cc1-9fbf-edd2b4f14d56 service swift] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:24:03.677004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:24:03.677941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:24:03.678222 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:24:03.678493 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] PATH_INFO: `/v3/users/3a0b2c33c8044d5f8908aace9c01d236` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:24:03.679813 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a0b2c33c8044d5f8908aace9c01d236)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:24:03.681843 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:24:03.734774 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a0b2c33c8044d5f8908aace9c01d236'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:03.735447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a0b2c33c8044d5f8908aace9c01d236'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:03.743491 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a0b2c33c8044d5f8908aace9c01d236'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:03.758284 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a0b2c33c8044d5f8908aace9c01d236'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:03.769658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a0b2c33c8044d5f8908aace9c01d236'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:03.776911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1368/2731] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:24:03 2021] DELETE /identity/v3/users/3a0b2c33c8044d5f8908aace9c01d236 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:24:03.976510 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:24:03.987854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312419a4-78e8-468d-b40d-fb41aec871d3 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:24:04.064934 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:24:04.065845 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:24:04.066129 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:24:04.066404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] PATH_INFO: `/v3/projects/76754ec1f4b143ceabbcb17af1aa513b` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:24:04.067713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76754ec1f4b143ceabbcb17af1aa513b)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:24:04.069661 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:24:04.118531 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76754ec1f4b143ceabbcb17af1aa513b', 'request_id': 'req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.124983 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76754ec1f4b143ceabbcb17af1aa513b', 'request_id': 'req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.131992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76754ec1f4b143ceabbcb17af1aa513b', 'request_id': 'req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.149133 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] The token cache is being invalidate because project 76754ec1f4b143ceabbcb17af1aa513b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:24:04.149354 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.150612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.152959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1364/2732] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:24:03 2021] DELETE /identity/v3/projects/76754ec1f4b143ceabbcb17af1aa513b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:24:04.157456 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:24:04.159514 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:24:04.176325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a12218-edb4-45c7-8ba7-1cf5442c370c admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:24:04.239019 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:24:04.239933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:24:04.240182 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:24:04.240463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] PATH_INFO: `/v3/users/a9f07b8a6d334d48bd4575a8b04d489d` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:24:04.242035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9f07b8a6d334d48bd4575a8b04d489d)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:24:04.244081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:24:04.294391 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9f07b8a6d334d48bd4575a8b04d489d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.295177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9f07b8a6d334d48bd4575a8b04d489d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.302925 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9f07b8a6d334d48bd4575a8b04d489d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.316910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9f07b8a6d334d48bd4575a8b04d489d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.329986 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-4e5b5d5c-5361-4274-a623-7ef1d0d0cefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9f07b8a6d334d48bd4575a8b04d489d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.341874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1369/2733] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:24:04 2021] DELETE /identity/v3/users/a9f07b8a6d334d48bd4575a8b04d489d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:24:04.532239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:24:04.534125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:24:04.547920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f2065-49e4-4f8c-bd1f-49de62f4aa68 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:24:04.614906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:24:04.615854 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:24:04.616132 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:24:04.616574 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] PATH_INFO: `/v3/projects/ba3f648fc9dd4cd3b5f5d20f45efc3fe` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:24:04.618012 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3f648fc9dd4cd3b5f5d20f45efc3fe)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:24:04.620265 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:24:04.685540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'request_id': 'req-6fc86402-45dc-49fc-a811-003fa28b18e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.692442 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'request_id': 'req-6fc86402-45dc-49fc-a811-003fa28b18e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.705681 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3f648fc9dd4cd3b5f5d20f45efc3fe', 'request_id': 'req-6fc86402-45dc-49fc-a811-003fa28b18e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.721384 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] The token cache is being invalidate because project ba3f648fc9dd4cd3b5f5d20f45efc3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:24:04.722085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.722725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:24:04.725255 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1365/2734] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:24:04 2021] DELETE /identity/v3/projects/ba3f648fc9dd4cd3b5f5d20f45efc3fe => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:24:35.761010 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de4ff-695b-4eb9-b02e-aeac27eefe96 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:24:35.761644 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de4ff-695b-4eb9-b02e-aeac27eefe96 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:24:35.762049 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de4ff-695b-4eb9-b02e-aeac27eefe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:24:35.782497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-7d9de4ff-695b-4eb9-b02e-aeac27eefe96 None None] MFA Rules not processed for user `d6268d6bbeb242949ba4aca2e1debde6`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:24:35.784485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7d9de4ff-695b-4eb9-b02e-aeac27eefe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:24:35.846694 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1370/2735] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:24:35 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:25:29.208029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:25:29.209634 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:29.271115 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc86402-45dc-49fc-a811-003fa28b18e6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:25:29.275025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:25:29.275683 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:25:29.275962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:25:29.276238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:25:29.278242 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:29.345085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:25:29.346656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:25:29.356612 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1366/2736] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:25:29 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:25:37.245511 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:25:37.246390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:25:37.246390 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:25:37.270457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] MFA Rules not processed for user `d83e82f8ae2e4203b5f0c5d120c58792`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:25:37.272162 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:37.280697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1371/2737] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:25:37 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:25:38.585711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:25:38.587177 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:38.670172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb22c95-50e5-4edb-a09e-2faeeec1d0ad service cinder] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:25:38.675658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5386e48-6716-4920-b716-99f6f63b6e90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:25:38.676323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386e48-6716-4920-b716-99f6f63b6e90 service placement] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:25:38.676607 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386e48-6716-4920-b716-99f6f63b6e90 service placement] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:25:38.676881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5386e48-6716-4920-b716-99f6f63b6e90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:25:38.679315 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f5386e48-6716-4920-b716-99f6f63b6e90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:38.691672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5386e48-6716-4920-b716-99f6f63b6e90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:25:38.693804 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5386e48-6716-4920-b716-99f6f63b6e90 service placement] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:25:38.704821 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1367/2738] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:25:38 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:25:45.071690 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:25:45.073355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:45.153862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560e1ba-64e0-47c1-9246-581db19701e9 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:25:45.159987 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:25:45.160643 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:25:45.160923 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:25:45.161200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:25:45.163136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:45.174921 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:25:45.177069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:25:45.188194 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1372/2739] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:25:45 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:25:45.660716 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:25:45.661202 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:25:45.661312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:25:45.686534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:25:45.687662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:45.751720 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1368/2740] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:25:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:25:45.807483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:25:45.809055 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:45.880863 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e188ada-b344-463d-9486-b2dc7b103f82 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:25:45.886976 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e618bd-fc4f-46c8-8bef-7cf8e7700e1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:25:45.887642 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e618bd-fc4f-46c8-8bef-7cf8e7700e1b service swift] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:25:45.887926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e618bd-fc4f-46c8-8bef-7cf8e7700e1b service swift] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:25:45.888195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e618bd-fc4f-46c8-8bef-7cf8e7700e1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:25:45.897830 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e618bd-fc4f-46c8-8bef-7cf8e7700e1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:25:45.899445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e618bd-fc4f-46c8-8bef-7cf8e7700e1b service swift] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:25:45.907920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1373/2741] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:25:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:25:54.386410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:25:54.388875 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:54.460433 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750dad60-ba9a-4491-ba66-ad75b340f9aa None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:25:54.464594 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457773ef-1102-48c3-a16f-0cfd5e9a3d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:25:54.465273 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457773ef-1102-48c3-a16f-0cfd5e9a3d3b service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:25:54.465593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457773ef-1102-48c3-a16f-0cfd5e9a3d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:25:54.465878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457773ef-1102-48c3-a16f-0cfd5e9a3d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:25:54.467745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-457773ef-1102-48c3-a16f-0cfd5e9a3d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:25:54.547116 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457773ef-1102-48c3-a16f-0cfd5e9a3d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:25:54.548722 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457773ef-1102-48c3-a16f-0cfd5e9a3d3b service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:25:54.560593 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1369/2742] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:25:54 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:26:02.117322 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0f9c-7b76-45b2-9fbb-92ac53c28b5e None None] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:02.117905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0f9c-7b76-45b2-9fbb-92ac53c28b5e None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:02.117905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e0f9c-7b76-45b2-9fbb-92ac53c28b5e None None] PATH_INFO: `/` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:02.119872 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1374/2743] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:26:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:26:02.126534 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c589cb-aaf2-49bf-a692-05bc978fe491 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:02.127068 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c589cb-aaf2-49bf-a692-05bc978fe491 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:02.127156 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c589cb-aaf2-49bf-a692-05bc978fe491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:02.147566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-31c589cb-aaf2-49bf-a692-05bc978fe491 None None] MFA Rules not processed for user `cf258dbbf82147618bc5310aebd91a65`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:26:02.148737 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-31c589cb-aaf2-49bf-a692-05bc978fe491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:26:02.161239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1370/2744] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:26:02 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:26:02.174874 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0f9c-7b76-45b2-9fbb-92ac53c28b5e None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:26:02.176933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-629e0f9c-7b76-45b2-9fbb-92ac53c28b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:26:02.237499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e0f9c-7b76-45b2-9fbb-92ac53c28b5e None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:26:02.241313 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87818f5-9f0b-4416-a5d1-e7c076f39699 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:26:02.242043 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87818f5-9f0b-4416-a5d1-e7c076f39699 service glance] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:02.242323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87818f5-9f0b-4416-a5d1-e7c076f39699 service glance] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:02.242582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87818f5-9f0b-4416-a5d1-e7c076f39699 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:02.254388 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87818f5-9f0b-4416-a5d1-e7c076f39699 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:26:02.255917 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87818f5-9f0b-4416-a5d1-e7c076f39699 service glance] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:26:02.267950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1375/2745] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:26:02 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:26:02.338869 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150a93-4b54-46ff-b5d8-9c63d9d14e4b None None] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:02.339086 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150a93-4b54-46ff-b5d8-9c63d9d14e4b None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:02.339404 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150a93-4b54-46ff-b5d8-9c63d9d14e4b None None] PATH_INFO: `/` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:02.341231 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1371/2746] 10.222.0.31 () {54 vars in 921 bytes} [Tue Nov 16 03:26:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 16 03:26:02.346550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4745-a9b8-4634-b730-d94c4c86a8fc None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:02.346853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4745-a9b8-4634-b730-d94c4c86a8fc None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:02.347133 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e4745-a9b8-4634-b730-d94c4c86a8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:02.366189 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-b51e4745-a9b8-4634-b730-d94c4c86a8fc None None] MFA Rules not processed for user `6d09511f0bb7411f9f8c06f49d3a5810`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:26:02.367411 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b51e4745-a9b8-4634-b730-d94c4c86a8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:26:02.374739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1376/2747] 10.222.0.31 () {58 vars in 1018 bytes} [Tue Nov 16 03:26:02 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:26:02.387745 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150a93-4b54-46ff-b5d8-9c63d9d14e4b None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:26:02.390585 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2e150a93-4b54-46ff-b5d8-9c63d9d14e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:26:02.411773 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150a93-4b54-46ff-b5d8-9c63d9d14e4b None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:26:02.416561 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:26:02.417220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:02.417530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:02.417810 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:02.425415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:26:02.426895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:26:02.434949 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1372/2748] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:26:02 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:26:04.460423 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87bb7-d5b2-4300-92ce-c30897035149 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:04.460951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87bb7-d5b2-4300-92ce-c30897035149 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:04.460951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87bb7-d5b2-4300-92ce-c30897035149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:04.480564 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ebb87bb7-d5b2-4300-92ce-c30897035149 None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:26:04.481800 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ebb87bb7-d5b2-4300-92ce-c30897035149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:26:04.490325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1377/2749] 10.222.0.31 () {58 vars in 1009 bytes} [Tue Nov 16 03:26:04 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:26:04.503483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:26:04.516482 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca0bd8-008f-4f3a-a82c-dbdf55f9130c service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:26:04.522698 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:26:04.523348 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:04.523614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:04.523886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:04.535142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:26:04.537459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:26:04.550654 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1373/2750] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:26:04 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:26:23.782713 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a61b-3cc0-46fa-ab7f-153ceb2a7b5c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:23.783698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a61b-3cc0-46fa-ab7f-153ceb2a7b5c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:23.783698 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a61b-3cc0-46fa-ab7f-153ceb2a7b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:23.803961 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-44e7a61b-3cc0-46fa-ab7f-153ceb2a7b5c None None] MFA Rules not processed for user `ee68d56c327f4e8eb32e019ea2326bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:26:23.805158 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-44e7a61b-3cc0-46fa-ab7f-153ceb2a7b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:26:23.823846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1378/2751] 10.222.0.31 () {58 vars in 967 bytes} [Tue Nov 16 03:26:23 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:26:23.833842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:26:23.845543 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f64a6-5f48-44ce-9925-72ac2d92c7c3 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:26:23.852281 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b580550112ae4c51a3bffea61ede5bb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:26:23.852973 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:26:23.853254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:26:23.853572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:26:23.863850 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:26:23.865475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:26:23.874876 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1374/2752] 10.222.0.31 () {60 vars in 1384 bytes} [Tue Nov 16 03:26:23 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 16 03:27:01.614822 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a61b-3cc0-46fa-ab7f-153ceb2a7b5c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:01.624674 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a61b-3cc0-46fa-ab7f-153ceb2a7b5c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:01.629038 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:01.629725 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:01.629997 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:01.630251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:01.632274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:01.646640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:01.648143 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:01.659591 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1379/2753] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:06.932590 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:06.942853 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49660c17-9195-4db1-bc99-7ca6363fd8e9 service swift] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:06.946955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:06.947604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:06.947878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:06.948145 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:06.950277 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:07.018533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:07.019977 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:07.030098 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1375/2754] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:10.255436 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:10.257277 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:10.275926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f05ed-eb58-4319-a2f5-5e0f791fbaa7 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:10.281996 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:10.283298 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:10.283577 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:10.283845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] PATH_INFO: `/v3/users/d6268d6bbeb242949ba4aca2e1debde6` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:10.285216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6268d6bbeb242949ba4aca2e1debde6)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:10.287210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:10.348268 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6268d6bbeb242949ba4aca2e1debde6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.349567 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6268d6bbeb242949ba4aca2e1debde6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.366556 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6268d6bbeb242949ba4aca2e1debde6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.379761 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6268d6bbeb242949ba4aca2e1debde6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.388327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd36f460-f8d1-494d-9e62-2e3d27a698e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6268d6bbeb242949ba4aca2e1debde6'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.395023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1380/2755] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:27:10 2021] DELETE /identity/v3/users/d6268d6bbeb242949ba4aca2e1debde6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:27:10.635121 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:10.653111 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5d440-21a0-404f-9a1e-b7626dcfa712 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:10.722847 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:10.723757 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:10.724039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:10.724313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] PATH_INFO: `/v3/projects/2852179c69834bda8a41052f2d958cd4` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:10.725680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2852179c69834bda8a41052f2d958cd4)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:10.727687 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:10.785563 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2852179c69834bda8a41052f2d958cd4', 'request_id': 'req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.794653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2852179c69834bda8a41052f2d958cd4', 'request_id': 'req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.801420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2852179c69834bda8a41052f2d958cd4', 'request_id': 'req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.818624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] The token cache is being invalidate because project 2852179c69834bda8a41052f2d958cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:27:10.818893 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.819516 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-48cb3ee8-6ef1-45e7-b5a7-55074e6e8253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:10.821096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1376/2756] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:27:10 2021] DELETE /identity/v3/projects/2852179c69834bda8a41052f2d958cd4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:27:10.827393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4d611-cb25-45a1-a091-45d0dd7c154d None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:10.827695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4d611-cb25-45a1-a091-45d0dd7c154d None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:10.827984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4d611-cb25-45a1-a091-45d0dd7c154d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:10.848047 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-48e4d611-cb25-45a1-a091-45d0dd7c154d None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:27:10.849290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-48e4d611-cb25-45a1-a091-45d0dd7c154d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:10.919000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1381/2757] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:27:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:27:10.927609 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea282d-949c-4885-ba1e-37db84d5abd3 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:10.927901 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea282d-949c-4885-ba1e-37db84d5abd3 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:10.928201 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea282d-949c-4885-ba1e-37db84d5abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:10.948092 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-99ea282d-949c-4885-ba1e-37db84d5abd3 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:27:10.949314 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-99ea282d-949c-4885-ba1e-37db84d5abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:10.958345 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1377/2758] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:27:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:27:10.963294 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4d611-cb25-45a1-a091-45d0dd7c154d None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:10.975920 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4d611-cb25-45a1-a091-45d0dd7c154d None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:10.981483 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:10.982201 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:10.982421 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:10.982697 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:10.983462 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:27:10.983784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:10.985520 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:10.999453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1382/2759] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:27:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:27:11.004640 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea282d-949c-4885-ba1e-37db84d5abd3 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:11.017361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea282d-949c-4885-ba1e-37db84d5abd3 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:11.024372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:11.025184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:11.025536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:11.025897 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:11.026955 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:11.029264 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:11.077339 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1378/2760] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:27:11 2021] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:27:11.081682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:11.092635 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3433e-8c0e-48c5-bf1e-1ef6329c6fe6 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:11.155361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:11.156050 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:11.156328 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:11.156824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:11.157657 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:11.160412 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:11.180578 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1383/2761] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:27:11 2021] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:27:11.184885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:11.197402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07df71-77d6-460a-9331-748c8ba24b2b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:11.203839 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:11.204214 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:11.204662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:11.204941 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:11.205753 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:11.207415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:11.219481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1379/2762] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:27:11.223910 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:11.238695 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6abc0-4777-4ea4-9dd9-b0859dbfc707 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:11.244821 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325a0e6-931a-4232-b559-7d84ea39d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:11.245505 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325a0e6-931a-4232-b559-7d84ea39d8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:11.245807 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325a0e6-931a-4232-b559-7d84ea39d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:11.246076 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325a0e6-931a-4232-b559-7d84ea39d8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:11.246791 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325a0e6-931a-4232-b559-7d84ea39d8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:11.248422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325a0e6-931a-4232-b559-7d84ea39d8ee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:11.259305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1384/2763] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:27:11.264317 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:11.275608 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abc6c8-404a-4da7-a464-eebb7e4d0753 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:11.281718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:11.283702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:11.287313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:11.287313 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] PATH_INFO: `/v3/projects/d0da71fd700f4fad877f51e2e7d7862e/users/4ccd6a0ee5794cb98f55d94a42229245/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:11.303668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0da71fd700f4fad877f51e2e7d7862e, user_id=4ccd6a0ee5794cb98f55d94a42229245, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:11.306690 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:11.322970 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1380/2764] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:27:11 2021] PUT /identity/v3/projects/d0da71fd700f4fad877f51e2e7d7862e/users/4ccd6a0ee5794cb98f55d94a42229245/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:27:11.328723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7effb-ae06-47f4-95b4-18711b44516a None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:11.328935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7effb-ae06-47f4-95b4-18711b44516a None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:11.329200 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7effb-ae06-47f4-95b4-18711b44516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:11.354903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-99c7effb-ae06-47f4-95b4-18711b44516a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:27:11.356122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-99c7effb-ae06-47f4-95b4-18711b44516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:11.420709 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1385/2765] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:27:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:27:11.429131 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:11.431078 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:11.494476 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf5f3-5fe5-4db2-8e34-cf8353086e53 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:11.498352 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:11.499025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:11.499323 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:11.499598 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:11.510408 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:11.511891 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:11.524578 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1381/2766] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:15.689906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2f379-0b04-46ed-809a-3c5c82c6a33b None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:15.690475 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2f379-0b04-46ed-809a-3c5c82c6a33b None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:15.690601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2f379-0b04-46ed-809a-3c5c82c6a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:15.722845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-8da2f379-0b04-46ed-809a-3c5c82c6a33b None None] MFA Rules not processed for user `4ccd6a0ee5794cb98f55d94a42229245`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:27:15.724434 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-8da2f379-0b04-46ed-809a-3c5c82c6a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:15.809569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1386/2767] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:27:15 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:27:15.822923 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:15.824577 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:15.911480 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f583061-08ec-4dae-b6b2-561d3d3445f0 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:15.922991 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:15.923679 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:15.923967 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:15.925085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:15.933459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:15.935142 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:15.948082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1382/2768] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:15 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:17.927898 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:17.928467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:17.928467 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:17.947131 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] MFA Rules not processed for user `4ccd6a0ee5794cb98f55d94a42229245`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:27:17.948346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:17.957539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1387/2769] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:27:17 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:27:17.995992 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:17.997379 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:18.093170 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5787e-5729-48eb-b012-b5baf83e758c service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:18.097210 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fd595065064131926ed83613a82ffc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:18.097914 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:18.098188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:18.098459 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:18.100305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:18.132713 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:18.134936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:18.150380 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1383/2770] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:17 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:18.875537 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:18.877332 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:18.967975 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b854d8a-f554-496a-84ed-5f142ffd4596 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:18.974374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:18.975035 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:18.975311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:18.975582 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:18.977463 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:18.990382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:18.992085 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:19.003589 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1388/2771] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:18 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:20.914619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:20.916540 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:20.929415 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073f4dd-cead-4f66-975b-84ff37e2b3f6 service glance] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:20.933501 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:20.934276 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:20.934437 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:20.934916 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:20.937144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:20.948287 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:20.949795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:20.959282 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1384/2772] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:20 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:40.476844 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:40.486766 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d84ac0-5b6f-46ed-a473-61cabac1c067 service placement] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:40.490759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:40.491424 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:40.491707 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:40.491981 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:40.494933 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:40.507794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:40.509245 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:40.518891 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1389/2773] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:27:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:27:47.136383 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:47.137940 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:47.154780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4f53-452f-4ca3-a1c3-358b5077a564 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:47.161013 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:47.162174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:47.162522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:47.162905 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] PATH_INFO: `/v3/users/d83e82f8ae2e4203b5f0c5d120c58792` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:47.164467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d83e82f8ae2e4203b5f0c5d120c58792)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:47.167026 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:47.215954 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd83e82f8ae2e4203b5f0c5d120c58792'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.216603 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd83e82f8ae2e4203b5f0c5d120c58792'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.223749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd83e82f8ae2e4203b5f0c5d120c58792'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.235283 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd83e82f8ae2e4203b5f0c5d120c58792'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.244453 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd83e82f8ae2e4203b5f0c5d120c58792'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.250902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1385/2774] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:27:47 2021] DELETE /identity/v3/users/d83e82f8ae2e4203b5f0c5d120c58792 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:27:47.432274 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:47.443142 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279eb67-3e15-44cf-9f27-8ef84544971f service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:47.505585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:47.506662 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:47.506999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:47.507345 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] PATH_INFO: `/v3/projects/f0e656658949487fb898565d34636908` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:47.509262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e656658949487fb898565d34636908)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:47.512139 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:47.562948 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e656658949487fb898565d34636908', 'request_id': 'req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.573030 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e656658949487fb898565d34636908', 'request_id': 'req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.578839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e656658949487fb898565d34636908', 'request_id': 'req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.592250 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] The token cache is being invalidate because project f0e656658949487fb898565d34636908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:27:47.592494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.594838 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.596500 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1390/2775] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:27:47 2021] DELETE /identity/v3/projects/f0e656658949487fb898565d34636908 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:27:47.601036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:47.602472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:47.615580 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ccad37-ac46-47dc-9cd5-0c9b9601320c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:47.679926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:47.680809 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:47.681091 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:47.681361 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] PATH_INFO: `/v3/users/752fb75be55d4cfbab72c0ea058347e6` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:47.682717 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=752fb75be55d4cfbab72c0ea058347e6)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:47.684630 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:47.733961 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752fb75be55d4cfbab72c0ea058347e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.734668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752fb75be55d4cfbab72c0ea058347e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.741653 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752fb75be55d4cfbab72c0ea058347e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.753206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752fb75be55d4cfbab72c0ea058347e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.765475 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752fb75be55d4cfbab72c0ea058347e6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:47.775429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1386/2776] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:27:47 2021] DELETE /identity/v3/users/752fb75be55d4cfbab72c0ea058347e6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:27:47.964474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:27:47.966028 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:27:47.981243 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3810eb6-4101-4e06-bbe1-d61c8134c2e8 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:27:48.046374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:27:48.047327 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:27:48.047611 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:27:48.047888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] PATH_INFO: `/v3/projects/f616d231885846a299f65758235aaa76` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:27:48.049227 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f616d231885846a299f65758235aaa76)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:27:48.051409 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:27:48.102561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f616d231885846a299f65758235aaa76', 'request_id': 'req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:48.109057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f616d231885846a299f65758235aaa76', 'request_id': 'req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:48.115419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f616d231885846a299f65758235aaa76', 'request_id': 'req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:48.130146 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] The token cache is being invalidate because project f616d231885846a299f65758235aaa76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:27:48.130428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:48.131130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:27:48.132783 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1391/2777] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:27:47 2021] DELETE /identity/v3/projects/f616d231885846a299f65758235aaa76 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:28:02.572371 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:28:02.574507 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:28:02.593895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8528b-9a81-476c-b2bd-a760ef6e4b31 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:28:02.662022 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:28:02.663128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:28:02.663472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:28:02.663789 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] PATH_INFO: `/v3/users/d50a2cbb753943a89b4722852ce191c1` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:28:02.665253 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50a2cbb753943a89b4722852ce191c1)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:28:02.667428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:28:02.725945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50a2cbb753943a89b4722852ce191c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:02.726818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50a2cbb753943a89b4722852ce191c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:02.735705 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50a2cbb753943a89b4722852ce191c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:02.748759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50a2cbb753943a89b4722852ce191c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:02.758919 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50a2cbb753943a89b4722852ce191c1'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:02.765303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1387/2778] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:28:02 2021] DELETE /identity/v3/users/d50a2cbb753943a89b4722852ce191c1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:28:02.960673 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:28:02.962599 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:28:02.978023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9185a-2e83-4fc2-9fb8-e19691165dc4 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:28:03.047536 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:28:03.048465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:28:03.048740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:28:03.049004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] PATH_INFO: `/v3/projects/2ea0808579e44cdcaeba4109bc12863b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:28:03.050478 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea0808579e44cdcaeba4109bc12863b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:28:03.052799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:28:03.112647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea0808579e44cdcaeba4109bc12863b', 'request_id': 'req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.120090 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea0808579e44cdcaeba4109bc12863b', 'request_id': 'req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.126429 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea0808579e44cdcaeba4109bc12863b', 'request_id': 'req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.141326 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] The token cache is being invalidate because project 2ea0808579e44cdcaeba4109bc12863b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:28:03.141637 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.142281 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.143846 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1392/2779] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:28:02 2021] DELETE /identity/v3/projects/2ea0808579e44cdcaeba4109bc12863b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:28:03.149550 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:28:03.151958 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:28:03.171878 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33246e-78ca-4aa2-8899-2dc0c768dc1c admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:28:03.233866 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:28:03.234774 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:28:03.235055 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:28:03.235333 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] PATH_INFO: `/v3/users/e968bc266de0465b8c0013e85b44e2a9` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:28:03.236633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e968bc266de0465b8c0013e85b44e2a9)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:28:03.238680 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:28:03.296186 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e968bc266de0465b8c0013e85b44e2a9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.296930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e968bc266de0465b8c0013e85b44e2a9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.305088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e968bc266de0465b8c0013e85b44e2a9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.318752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e968bc266de0465b8c0013e85b44e2a9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.328174 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e968bc266de0465b8c0013e85b44e2a9'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.335338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1388/2780] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:28:03 2021] DELETE /identity/v3/users/e968bc266de0465b8c0013e85b44e2a9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:28:03.539634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:28:03.541827 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:28:03.559754 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802b5c9-28ce-45e1-a4e2-6b9d92642c3d admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:28:03.626477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:28:03.627329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:28:03.627792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:28:03.628134 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] PATH_INFO: `/v3/projects/e8cfa442410048ee8abafea0f22e1fa1` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:28:03.629359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8cfa442410048ee8abafea0f22e1fa1)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:28:03.631441 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:28:03.686398 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8cfa442410048ee8abafea0f22e1fa1', 'request_id': 'req-73c6c3c3-a38f-42c3-bf45-441a62b92826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.693251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8cfa442410048ee8abafea0f22e1fa1', 'request_id': 'req-73c6c3c3-a38f-42c3-bf45-441a62b92826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.699408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8cfa442410048ee8abafea0f22e1fa1', 'request_id': 'req-73c6c3c3-a38f-42c3-bf45-441a62b92826'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.714016 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] The token cache is being invalidate because project e8cfa442410048ee8abafea0f22e1fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79351) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:28:03.714323 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.714954 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-73c6c3c3-a38f-42c3-bf45-441a62b92826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:28:03.716503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1393/2781] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:28:03 2021] DELETE /identity/v3/projects/e8cfa442410048ee8abafea0f22e1fa1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:29:55.882024 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:29:55.883903 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:29:56.056980 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0403a-5878-4031-92a5-7826342144e0 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:29:56.125962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:29:56.126639 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:29:56.126987 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:29:56.127327 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:29:56.129183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:29:56.141565 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:29:56.143128 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:29:56.154178 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1389/2782] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:29:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:29:58.936999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:29:58.937616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:29:58.937616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:29:58.955672 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] MFA Rules not processed for user `4ccd6a0ee5794cb98f55d94a42229245`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:29:58.956915 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:29:59.017977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1394/2783] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:29:58 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:29:59.354494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:29:59.356658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:29:59.440360 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca69aa-6b6c-48e1-87e2-f79bd2db95b1 service nova] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:29:59.445089 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:29:59.445772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:29:59.446061 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:29:59.446338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:29:59.448572 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:29:59.459318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:29:59.461014 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:29:59.469775 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1390/2784] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:29:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:30:07.540499 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:30:07.542290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:30:07.559757 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b113b-30cc-439e-bf46-b739b3bebce4 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:30:07.566316 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf258dbbf82147618bc5310aebd91a65', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:30:07.567025 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:30:07.567304 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:30:07.567568 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:30:07.569519 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:30:07.583368 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:30:07.584979 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:30:07.596311 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1395/2785] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:30:07 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:12.830938 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:12.832445 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:12.930329 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f92755-cbb3-4543-baf1-e7064b3945b0 service neutron] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:12.936127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:12.936781 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:12.937059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:12.937331 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:12.939581 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:12.952487 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:12.954227 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:12.964522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1391/2786] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:12 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:22.069958 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:22.071540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:22.167495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aae162-8e48-4730-a48b-e571728679b9 service nova] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:22.172489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:22.173320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:22.173668 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:22.173935 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] PATH_INFO: `/v3/users/4ccd6a0ee5794cb98f55d94a42229245` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:22.175160 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccd6a0ee5794cb98f55d94a42229245)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:22.177066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:22.237839 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccd6a0ee5794cb98f55d94a42229245'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.238501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccd6a0ee5794cb98f55d94a42229245'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.246285 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccd6a0ee5794cb98f55d94a42229245'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.258983 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccd6a0ee5794cb98f55d94a42229245'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.267893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-1629644a-902c-4091-9da8-c7d99e6998f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccd6a0ee5794cb98f55d94a42229245'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.274454 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1396/2787] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:31:22 2021] DELETE /identity/v3/users/4ccd6a0ee5794cb98f55d94a42229245 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:22.465910 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:22.479461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c2199-1a6d-45c8-9b1b-126f8c07abb3 service placement] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:22.538441 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:22.539293 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:22.539571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:22.539826 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] PATH_INFO: `/v3/projects/d0da71fd700f4fad877f51e2e7d7862e` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:22.541057 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0da71fd700f4fad877f51e2e7d7862e)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:22.543006 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:22.591467 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0da71fd700f4fad877f51e2e7d7862e', 'request_id': 'req-56a5e10f-6c87-422c-849e-34b37c7d8b66'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.597758 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0da71fd700f4fad877f51e2e7d7862e', 'request_id': 'req-56a5e10f-6c87-422c-849e-34b37c7d8b66'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.603085 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0da71fd700f4fad877f51e2e7d7862e', 'request_id': 'req-56a5e10f-6c87-422c-849e-34b37c7d8b66'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.617539 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] The token cache is being invalidate because project d0da71fd700f4fad877f51e2e7d7862e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:31:22.617811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.618472 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-56a5e10f-6c87-422c-849e-34b37c7d8b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:22.620058 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1392/2788] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:31:22 2021] DELETE /identity/v3/projects/d0da71fd700f4fad877f51e2e7d7862e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:22.626984 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3ac8-6e2f-4edf-ad7c-d87221f09152 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:22.627260 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3ac8-6e2f-4edf-ad7c-d87221f09152 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:22.627527 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3ac8-6e2f-4edf-ad7c-d87221f09152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:22.690042 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-f37c3ac8-6e2f-4edf-ad7c-d87221f09152 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:22.691267 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-f37c3ac8-6e2f-4edf-ad7c-d87221f09152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:22.757333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1397/2789] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:31:22.765749 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5086-cfa9-4117-a452-76a2a394dd82 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:22.766029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5086-cfa9-4117-a452-76a2a394dd82 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:22.766303 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5086-cfa9-4117-a452-76a2a394dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:22.785976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-ad9a5086-cfa9-4117-a452-76a2a394dd82 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:22.787182 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-ad9a5086-cfa9-4117-a452-76a2a394dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:22.797008 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1393/2790] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:22.801374 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3ac8-6e2f-4edf-ad7c-d87221f09152 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:22.811950 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3ac8-6e2f-4edf-ad7c-d87221f09152 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:22.817512 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:22.818177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:22.818461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:22.818734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:22.819481 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:31:22.819785 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:22.821396 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:22.833797 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1398/2791] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:31:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:31:22.838463 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a5086-cfa9-4117-a452-76a2a394dd82 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:22.847954 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a5086-cfa9-4117-a452-76a2a394dd82 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:22.853308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:22.854059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:22.854338 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:22.854606 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:22.855428 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:22.857420 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:22.886920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1394/2792] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:31:22 2021] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:22.891148 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:22.901904 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa19ec6-1b43-4b03-9cde-8ffbc4f57fee admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:22.959594 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:22.960154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:22.960432 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:22.960701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:22.961397 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:22.963348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:22.986283 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1399/2793] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:31:22 2021] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:22.990432 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:23.001631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4cdcc-e04c-486a-98e4-d71ee8a4fa18 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:23.006936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:23.007658 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:23.007912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:23.008192 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:23.008948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:23.010635 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:23.022215 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1395/2794] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:23.026776 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:23.037905 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e5a50-9817-4c99-96d3-ee5e16fc6c05 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:23.043632 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e29ee2-aa0d-4018-84dc-d5418dac8514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:23.044286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29ee2-aa0d-4018-84dc-d5418dac8514 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:23.044645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29ee2-aa0d-4018-84dc-d5418dac8514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:23.044926 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e29ee2-aa0d-4018-84dc-d5418dac8514 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:23.045701 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e29ee2-aa0d-4018-84dc-d5418dac8514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:23.047301 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e29ee2-aa0d-4018-84dc-d5418dac8514 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:23.058107 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1400/2795] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:31:23.062662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:23.073149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca863eb7-f0cd-4196-ae40-16f243f42aed admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:23.079260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:23.080149 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:23.080430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:23.080730 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] PATH_INFO: `/v3/projects/8a7c839e7ddd448ebbbda823ef12bfbd/users/078f010b57cc467baeb50a595b0ddc0b/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:23.097235 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7c839e7ddd448ebbbda823ef12bfbd, user_id=078f010b57cc467baeb50a595b0ddc0b, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:23.099945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:23.118451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1396/2796] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:23 2021] PUT /identity/v3/projects/8a7c839e7ddd448ebbbda823ef12bfbd/users/078f010b57cc467baeb50a595b0ddc0b/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:23.128759 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e5c45-5bc0-451b-8885-15759c07c3a8 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:23.129330 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e5c45-5bc0-451b-8885-15759c07c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:23.129477 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e5c45-5bc0-451b-8885-15759c07c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:23.156747 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-841e5c45-5bc0-451b-8885-15759c07c3a8 None None] MFA Rules not processed for user `078f010b57cc467baeb50a595b0ddc0b`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:23.158416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-841e5c45-5bc0-451b-8885-15759c07c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:23.229900 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1401/2797] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:23 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:23.240196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:23.242088 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:23.330811 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656575f7-eeb9-4f78-9d24-882080bca545 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:23.335029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4789a-b7b6-44c8-8ec5-bded485e8a4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:23.335672 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4789a-b7b6-44c8-8ec5-bded485e8a4b service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:23.335952 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4789a-b7b6-44c8-8ec5-bded485e8a4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:23.336234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4789a-b7b6-44c8-8ec5-bded485e8a4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:23.344962 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4789a-b7b6-44c8-8ec5-bded485e8a4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:23.346430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4789a-b7b6-44c8-8ec5-bded485e8a4b service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:23.355040 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1397/2798] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:23 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:31.807851 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e5c45-5bc0-451b-8885-15759c07c3a8 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:31.881385 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e5c45-5bc0-451b-8885-15759c07c3a8 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:31.887854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:31.888734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:31.889036 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:31.889305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] PATH_INFO: `/v3/users/078f010b57cc467baeb50a595b0ddc0b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:31.890670 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=078f010b57cc467baeb50a595b0ddc0b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:31.893095 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:31.943565 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078f010b57cc467baeb50a595b0ddc0b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:31.944150 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078f010b57cc467baeb50a595b0ddc0b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:31.950951 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078f010b57cc467baeb50a595b0ddc0b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:31.966932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078f010b57cc467baeb50a595b0ddc0b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:31.977601 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078f010b57cc467baeb50a595b0ddc0b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:31.986465 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1402/2799] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:31:31 2021] DELETE /identity/v3/users/078f010b57cc467baeb50a595b0ddc0b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:31.991188 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:31.991706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:31.991706 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.009478 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:32.010656 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:32.073312 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1398/2800] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:32.083960 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:32.085729 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:32.154079 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b15789-10c0-48de-b8a6-24bef7f91f2a admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:32.159516 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10425fd3-4c30-48bd-be7b-d706f4a7f2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:32.160172 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10425fd3-4c30-48bd-be7b-d706f4a7f2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.160442 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10425fd3-4c30-48bd-be7b-d706f4a7f2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.160721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10425fd3-4c30-48bd-be7b-d706f4a7f2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.170693 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10425fd3-4c30-48bd-be7b-d706f4a7f2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:32.172152 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10425fd3-4c30-48bd-be7b-d706f4a7f2a3 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:32.181888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1403/2801] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:32.455019 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:32.456604 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:32.469677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b258717-2c43-4fe6-bbc8-fec47ebf0569 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:32.474886 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:32.475865 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.476203 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.476479 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] PATH_INFO: `/v3/projects/8a7c839e7ddd448ebbbda823ef12bfbd` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.477929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7c839e7ddd448ebbbda823ef12bfbd)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:32.479896 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:32.532369 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7c839e7ddd448ebbbda823ef12bfbd', 'request_id': 'req-73076fe1-0525-437a-8ac6-23e78da7140e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:32.539187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7c839e7ddd448ebbbda823ef12bfbd', 'request_id': 'req-73076fe1-0525-437a-8ac6-23e78da7140e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:32.544841 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7c839e7ddd448ebbbda823ef12bfbd', 'request_id': 'req-73076fe1-0525-437a-8ac6-23e78da7140e'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:32.558715 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] The token cache is being invalidate because project 8a7c839e7ddd448ebbbda823ef12bfbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:31:32.559034 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:32.559652 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-73076fe1-0525-437a-8ac6-23e78da7140e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:32.561234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1399/2802] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:31:32 2021] DELETE /identity/v3/projects/8a7c839e7ddd448ebbbda823ef12bfbd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:32.567872 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd3e7-4964-409e-975e-2851b1408b14 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.568155 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd3e7-4964-409e-975e-2851b1408b14 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.568427 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdbd3e7-4964-409e-975e-2851b1408b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.589252 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-efdbd3e7-4964-409e-975e-2851b1408b14 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:32.590498 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-efdbd3e7-4964-409e-975e-2851b1408b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:32.651383 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1404/2803] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:32.660107 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d44e2-d945-4d6b-912d-c2d767a201a5 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.660396 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d44e2-d945-4d6b-912d-c2d767a201a5 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.660664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d44e2-d945-4d6b-912d-c2d767a201a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.682959 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-720d44e2-d945-4d6b-912d-c2d767a201a5 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:32.684696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-720d44e2-d945-4d6b-912d-c2d767a201a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:32.694976 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1400/2804] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:32.699540 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd3e7-4964-409e-975e-2851b1408b14 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:32.710003 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdbd3e7-4964-409e-975e-2851b1408b14 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:32.715862 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:32.716525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.716804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.717075 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.717858 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:31:32.718181 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:32.720226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:32.732014 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1405/2805] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:31:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:31:32.737007 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d44e2-d945-4d6b-912d-c2d767a201a5 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:32.750530 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d44e2-d945-4d6b-912d-c2d767a201a5 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:32.756614 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:32.757271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.757582 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.757819 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.758533 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:32.760427 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:32.797353 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1401/2806] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:31:32 2021] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:31:32.801977 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:32.814361 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5aa1-3652-4f0c-a2a0-5216b34a6381 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:32.870130 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:32.870852 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.871125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.871393 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.872255 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:32.874446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:32.902394 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1406/2807] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:31:32 2021] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:32.908423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:32.919297 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43245e9d-5da3-4fe9-88dd-1f3daebdf3b6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:32.924571 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:32.925229 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.925537 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.925816 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.926566 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:32.928183 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:32.939110 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1402/2808] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:32 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:32.943659 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:32.959769 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718fec05-b90d-44de-b0e6-5012fdb26df7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:32.967893 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f34a345-2adf-4e98-b28a-b5dcbf22da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:32.968969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a345-2adf-4e98-b28a-b5dcbf22da08 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:32.969448 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a345-2adf-4e98-b28a-b5dcbf22da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:32.969801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f34a345-2adf-4e98-b28a-b5dcbf22da08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:32.970746 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34a345-2adf-4e98-b28a-b5dcbf22da08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:32.972561 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f34a345-2adf-4e98-b28a-b5dcbf22da08 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:32.988337 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1407/2809] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:32 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:32.994465 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.006725 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762810c-160d-4f88-8f33-22d724a0fddd admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.012374 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.013280 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.013602 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.013881 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] PATH_INFO: `/v3/projects/39fd1a0154bc475fbd671a0e70315773/users/1715f6876f964eb88164f944868a3ee3/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.029786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fd1a0154bc475fbd671a0e70315773, user_id=1715f6876f964eb88164f944868a3ee3, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.033060 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.048083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1403/2810] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:32 2021] PUT /identity/v3/projects/39fd1a0154bc475fbd671a0e70315773/users/1715f6876f964eb88164f944868a3ee3/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:33.060461 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a738-2303-4363-a284-4d88338d32a1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.060931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a738-2303-4363-a284-4d88338d32a1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.061346 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97a738-2303-4363-a284-4d88338d32a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.090903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-ea97a738-2303-4363-a284-4d88338d32a1 None None] MFA Rules not processed for user `1715f6876f964eb88164f944868a3ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:33.092125 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-ea97a738-2303-4363-a284-4d88338d32a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:33.160416 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1408/2811] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:33 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:33.165081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.232971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a8e6c0-e44e-44d2-938b-16a4546f85ef admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.238004 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.238668 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.238971 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.239234 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.239902 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.241842 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.270171 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1404/2812] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:31:33 2021] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:33.274151 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97a738-2303-4363-a284-4d88338d32a1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.286554 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97a738-2303-4363-a284-4d88338d32a1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.349017 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.349727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.350007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.350282 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.351000 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.352969 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.376037 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1409/2813] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:31:33 2021] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:31:33.382189 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.396125 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1630b-5d50-4eb9-8420-18f3a537b237 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.401929 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.402616 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.402895 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.403164 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.403906 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.405552 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.418862 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1405/2814] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:33 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:33.423354 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.434587 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba7c58-8599-467a-b4d2-e48431d712ab admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.440156 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.441022 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.441305 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.441609 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] PATH_INFO: `/v3/projects/d49b9dc90d594df793e972bc2cd747da/users/121144f7c45a4f489b3e7280f4ed7c7b/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.457801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49b9dc90d594df793e972bc2cd747da, user_id=121144f7c45a4f489b3e7280f4ed7c7b, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.460495 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.480356 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1410/2815] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:33 2021] PUT /identity/v3/projects/d49b9dc90d594df793e972bc2cd747da/users/121144f7c45a4f489b3e7280f4ed7c7b/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:33.486097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.496874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4488-5685-491a-9ba7-a3b70d27a2ab admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.564515 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853081f-e0e8-4d9a-8662-abf9f84ed965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.565196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853081f-e0e8-4d9a-8662-abf9f84ed965 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.565473 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853081f-e0e8-4d9a-8662-abf9f84ed965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.565780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853081f-e0e8-4d9a-8662-abf9f84ed965 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.566506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853081f-e0e8-4d9a-8662-abf9f84ed965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.568144 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853081f-e0e8-4d9a-8662-abf9f84ed965 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.578596 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1406/2816] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:33 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:33.583237 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.594348 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f4e30-db5b-4526-be78-9ae56b10f892 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.599612 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.600497 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.600773 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.601060 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] PATH_INFO: `/v3/projects/d49b9dc90d594df793e972bc2cd747da/users/121144f7c45a4f489b3e7280f4ed7c7b/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.603616 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d49b9dc90d594df793e972bc2cd747da, user_id=121144f7c45a4f489b3e7280f4ed7c7b, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.606271 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.617889 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1411/2817] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:33 2021] PUT /identity/v3/projects/d49b9dc90d594df793e972bc2cd747da/users/121144f7c45a4f489b3e7280f4ed7c7b/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:33.629494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.629786 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.630082 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.658027 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] MFA Rules not processed for user `121144f7c45a4f489b3e7280f4ed7c7b`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:33.659258 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:33.743423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1407/2818] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:33 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:33.755362 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.758011 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:33.826687 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19ceff-502e-48eb-b514-4ee7ae26e896 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.832123 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.832810 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.833063 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.833333 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.844485 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.845998 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.855421 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1412/2819] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:33 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:33.901043 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:33.902619 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:33.915489 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c10e21-f444-4eb8-b430-4440f3d5354f None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:33.919544 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a51577-6761-4202-9fbc-a67449f7267a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:33.920184 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51577-6761-4202-9fbc-a67449f7267a service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:33.920470 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51577-6761-4202-9fbc-a67449f7267a service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:33.920768 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51577-6761-4202-9fbc-a67449f7267a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:33.980063 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a51577-6761-4202-9fbc-a67449f7267a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:33.981548 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a51577-6761-4202-9fbc-a67449f7267a service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:33.990747 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1408/2820] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:33 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:31:37.331056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:37.398248 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba7983-12c2-4c67-b9c9-6f376ee4f6a7 service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:37.407059 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:37.408739 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:37.409147 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:37.409422 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] PATH_INFO: `/v3/users/1715f6876f964eb88164f944868a3ee3` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:37.410798 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1715f6876f964eb88164f944868a3ee3)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:37.412790 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:37.473932 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1715f6876f964eb88164f944868a3ee3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:37.474645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1715f6876f964eb88164f944868a3ee3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:37.481683 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1715f6876f964eb88164f944868a3ee3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:37.495120 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1715f6876f964eb88164f944868a3ee3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:37.505091 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1715f6876f964eb88164f944868a3ee3'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:37.511433 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1413/2821] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:31:37 2021] DELETE /identity/v3/users/1715f6876f964eb88164f944868a3ee3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:37.516260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:37.516836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:37.516836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:37.535791 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:37.536982 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:37.598556 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1409/2822] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:37.608629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:37.610532 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:37.682066 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c4d5e-02d0-4b7a-842d-c91094c00158 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:37.686545 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:37.687198 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:37.687476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:37.687767 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:37.697580 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:37.699027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:37.710943 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1414/2823] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:38.019750 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:38.021236 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:38.033686 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a596ec-ba91-4064-b723-06fa244b9f5a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:38.039296 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:38.040172 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:38.040451 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:38.040718 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] PATH_INFO: `/v3/projects/39fd1a0154bc475fbd671a0e70315773` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:38.042127 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fd1a0154bc475fbd671a0e70315773)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:38.044081 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:38.091885 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fd1a0154bc475fbd671a0e70315773', 'request_id': 'req-69b6c987-76f2-45b1-864d-900e98bb282b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.098187 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fd1a0154bc475fbd671a0e70315773', 'request_id': 'req-69b6c987-76f2-45b1-864d-900e98bb282b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.104039 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fd1a0154bc475fbd671a0e70315773', 'request_id': 'req-69b6c987-76f2-45b1-864d-900e98bb282b'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.117824 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] The token cache is being invalidate because project 39fd1a0154bc475fbd671a0e70315773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:31:38.118064 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.118657 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.120260 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1410/2824] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:31:38 2021] DELETE /identity/v3/projects/39fd1a0154bc475fbd671a0e70315773 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:38.124446 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:38.134631 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1438dd-dcf4-40ff-b164-82e8dfb1063e service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:38.192645 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:38.193555 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:38.193811 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:38.194122 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] PATH_INFO: `/v3/users/121144f7c45a4f489b3e7280f4ed7c7b` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:38.195382 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121144f7c45a4f489b3e7280f4ed7c7b)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:38.197286 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:38.247685 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121144f7c45a4f489b3e7280f4ed7c7b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.248319 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121144f7c45a4f489b3e7280f4ed7c7b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.255028 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121144f7c45a4f489b3e7280f4ed7c7b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.266974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121144f7c45a4f489b3e7280f4ed7c7b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.275782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-cd12b0c1-5040-4ac5-9fe4-c1d0d15f4093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121144f7c45a4f489b3e7280f4ed7c7b'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.281941 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1415/2825] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:31:38 2021] DELETE /identity/v3/users/121144f7c45a4f489b3e7280f4ed7c7b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:38.576239 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:38.578025 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:38.591772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b6c987-76f2-45b1-864d-900e98bb282b admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:38.653410 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:38.654208 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:38.654483 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:38.654780 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] PATH_INFO: `/v3/projects/d49b9dc90d594df793e972bc2cd747da` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:38.655935 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d49b9dc90d594df793e972bc2cd747da)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:38.658254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:38.708346 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd49b9dc90d594df793e972bc2cd747da', 'request_id': 'req-78613904-aeeb-4c41-9ad1-706aec0c8264'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.714714 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd49b9dc90d594df793e972bc2cd747da', 'request_id': 'req-78613904-aeeb-4c41-9ad1-706aec0c8264'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.721002 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd49b9dc90d594df793e972bc2cd747da', 'request_id': 'req-78613904-aeeb-4c41-9ad1-706aec0c8264'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.736930 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] The token cache is being invalidate because project d49b9dc90d594df793e972bc2cd747da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:31:38.737402 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.738051 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-78613904-aeeb-4c41-9ad1-706aec0c8264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:38.739677 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1411/2826] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:31:38 2021] DELETE /identity/v3/projects/d49b9dc90d594df793e972bc2cd747da => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:38.745903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc26e-7009-4014-950e-a6064731f970 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:38.746408 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc26e-7009-4014-950e-a6064731f970 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:38.746550 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc26e-7009-4014-950e-a6064731f970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:38.766053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-726dc26e-7009-4014-950e-a6064731f970 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:38.767269 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-726dc26e-7009-4014-950e-a6064731f970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:38.827911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1416/2827] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:38.836367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304b5d-7152-49ce-b630-f438a3081246 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:38.836650 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304b5d-7152-49ce-b630-f438a3081246 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:38.836920 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b304b5d-7152-49ce-b630-f438a3081246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:38.856096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-7b304b5d-7152-49ce-b630-f438a3081246 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:38.857347 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-7b304b5d-7152-49ce-b630-f438a3081246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:38.865300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1412/2828] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:38.870168 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dc26e-7009-4014-950e-a6064731f970 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:38.883634 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dc26e-7009-4014-950e-a6064731f970 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:38.889309 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:38.889999 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:38.890279 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:38.890548 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:38.891290 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:31:38.891597 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:38.893210 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:38.906007 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1417/2829] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:31:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:31:38.911103 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304b5d-7152-49ce-b630-f438a3081246 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:38.921372 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b304b5d-7152-49ce-b630-f438a3081246 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:38.930194 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:38.931195 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:38.931675 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:38.932122 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:38.933190 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:38.936070 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:38.966837 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1413/2830] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:31:38 2021] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:38.972476 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:38.983231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8389d-ed70-4989-bfa8-47935c336d83 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.053112 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.053803 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.054117 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.054381 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.055110 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.057073 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.079365 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1418/2831] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:31:38 2021] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:31:39.086309 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.102254 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34cf65c-4628-4f2b-94a5-819fdb919110 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.109926 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.110595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.110931 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.111295 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.112365 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.118401 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.127709 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1414/2832] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:39 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:31:39.132799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.143053 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6c2e1-f26f-4423-85d9-3288d01e3b54 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.148064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2122550-b8b9-4dc3-aabf-2c18d82046ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.148721 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122550-b8b9-4dc3-aabf-2c18d82046ae admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.148991 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122550-b8b9-4dc3-aabf-2c18d82046ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.149262 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122550-b8b9-4dc3-aabf-2c18d82046ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.150040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2122550-b8b9-4dc3-aabf-2c18d82046ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.151636 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2122550-b8b9-4dc3-aabf-2c18d82046ae admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.162352 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1419/2833] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:39.166738 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.177695 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5f4ae-6158-48ae-8c1f-49a5ae1a6f43 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.183271 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.184150 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.184429 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.184702 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] PATH_INFO: `/v3/projects/89068f7ff64749c5942213dd9e01c551/users/6d60d4684add46689c576af6f1d692ea/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.200059 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=89068f7ff64749c5942213dd9e01c551, user_id=6d60d4684add46689c576af6f1d692ea, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.202739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.223969 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1415/2834] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:39 2021] PUT /identity/v3/projects/89068f7ff64749c5942213dd9e01c551/users/6d60d4684add46689c576af6f1d692ea/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:39.236178 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2a09-3dec-4c46-abcd-80d65854f0e1 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.236522 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2a09-3dec-4c46-abcd-80d65854f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.236894 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafa2a09-3dec-4c46-abcd-80d65854f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.264664 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-cafa2a09-3dec-4c46-abcd-80d65854f0e1 None None] MFA Rules not processed for user `6d60d4684add46689c576af6f1d692ea`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:39.265911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-cafa2a09-3dec-4c46-abcd-80d65854f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:39.335626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1420/2835] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:39.340547 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.405664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ee68d-4bc8-4a07-b72c-5d673056cfea admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.412595 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.413219 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.413520 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.413771 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.414477 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.416818 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.446461 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1416/2836] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:31:39 2021] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:39.450676 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2a09-3dec-4c46-abcd-80d65854f0e1 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.461764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafa2a09-3dec-4c46-abcd-80d65854f0e1 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.519869 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.520528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.520804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.521077 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.521801 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.523735 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.545445 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1421/2837] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:31:39 2021] POST /identity/v3/users => generated 307 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 16 03:31:39.549633 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.560522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87e20f-59b1-4175-9201-c3861595cad2 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.565526 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.566225 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.566506 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.566778 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.567536 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.569207 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.580367 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1417/2838] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:39 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:39.585246 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.595854 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b58f48-5211-4e39-9874-fe4aa10788f7 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.602296 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.603177 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.603453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.603719 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] PATH_INFO: `/v3/projects/8540b673e2364c86a1a1dcaa313d546a/users/ae9d569cc5474b578e05927ae1cf066f/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.621734 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8540b673e2364c86a1a1dcaa313d546a, user_id=ae9d569cc5474b578e05927ae1cf066f, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.624392 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.641216 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1422/2839] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:39 2021] PUT /identity/v3/projects/8540b673e2364c86a1a1dcaa313d546a/users/ae9d569cc5474b578e05927ae1cf066f/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:31:39.647637 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.659029 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7ba1-3575-434c-b257-44185ee66a20 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.718083 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732a656-ab0a-4e56-b389-4b4f6ecab7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.718752 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a656-ab0a-4e56-b389-4b4f6ecab7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.719093 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a656-ab0a-4e56-b389-4b4f6ecab7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.719363 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732a656-ab0a-4e56-b389-4b4f6ecab7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.720109 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a656-ab0a-4e56-b389-4b4f6ecab7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.721898 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732a656-ab0a-4e56-b389-4b4f6ecab7ee admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.735096 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1418/2840] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:39 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 16 03:31:39.740629 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.757114 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024b78-b0bf-4f4f-b631-b6f70d8860fd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.762614 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.763503 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] REQUEST_METHOD: `PUT` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.763784 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.764057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] PATH_INFO: `/v3/projects/8540b673e2364c86a1a1dcaa313d546a/users/ae9d569cc5474b578e05927ae1cf066f/roles/5308483f37b74ac6aa272e02c97d6324` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.766191 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8540b673e2364c86a1a1dcaa313d546a, user_id=ae9d569cc5474b578e05927ae1cf066f, role_id=5308483f37b74ac6aa272e02c97d6324)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.769086 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.780129 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1423/2841] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:39 2021] PUT /identity/v3/projects/8540b673e2364c86a1a1dcaa313d546a/users/ae9d569cc5474b578e05927ae1cf066f/roles/5308483f37b74ac6aa272e02c97d6324 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 16 03:31:39.791148 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dcf4a-a234-465e-9607-7510ffc59915 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.791430 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dcf4a-a234-465e-9607-7510ffc59915 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.791696 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dcf4a-a234-465e-9607-7510ffc59915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.825206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-620dcf4a-a234-465e-9607-7510ffc59915 None None] MFA Rules not processed for user `ae9d569cc5474b578e05927ae1cf066f`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:39.826549 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-620dcf4a-a234-465e-9607-7510ffc59915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:39.897535 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1419/2842] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:39 2021] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:39.908057 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:39.910359 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:39.971796 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c763196-691c-4dc0-b4e0-84e273c298bd admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:39.976370 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:39.977004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:39.977264 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:39.977569 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:39.987603 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:39.989027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:39.998471 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1424/2843] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:39 2021] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:40.083795 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dcf4a-a234-465e-9607-7510ffc59915 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:40.099341 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dcf4a-a234-465e-9607-7510ffc59915 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:40.106154 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510012fa-892a-433a-9d6f-031a390b281f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:40.107161 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510012fa-892a-433a-9d6f-031a390b281f service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:40.107618 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510012fa-892a-433a-9d6f-031a390b281f service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:40.107998 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510012fa-892a-433a-9d6f-031a390b281f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:40.170691 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510012fa-892a-433a-9d6f-031a390b281f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:40.172960 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510012fa-892a-433a-9d6f-031a390b281f service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:40.187469 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1420/2844] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:40 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:44.293782 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:44.363360 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dad53-6751-4dfe-a04c-62ce80ad61ae service cinder] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:44.368230 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:44.369056 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:44.369325 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:44.369648 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] PATH_INFO: `/v3/users/6d60d4684add46689c576af6f1d692ea` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:44.370881 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d60d4684add46689c576af6f1d692ea)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:44.372823 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:44.421251 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d60d4684add46689c576af6f1d692ea'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:44.422013 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d60d4684add46689c576af6f1d692ea'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:44.429447 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d60d4684add46689c576af6f1d692ea'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:44.441899 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d60d4684add46689c576af6f1d692ea'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:44.451195 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d60d4684add46689c576af6f1d692ea'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:44.457329 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1425/2845] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:31:44 2021] DELETE /identity/v3/users/6d60d4684add46689c576af6f1d692ea => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:44.464664 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:44.465911 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:44.466232 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:44.495438 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:44.496671 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:44.566981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1421/2846] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:31:44.579871 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:44.581723 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:44.642562 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d6242-294c-47f5-b908-30bab537af01 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:44.646826 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:44.647474 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:44.647749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:44.648027 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:44.658004 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:44.659450 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:44.670040 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1426/2847] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 16 03:31:44.950624 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:44.952261 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:44.965924 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2d9ba3-0304-498b-b36b-ba30ee7a3e8a None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:44.972318 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:44.973196 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:44.973522 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:44.973787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] PATH_INFO: `/v3/projects/89068f7ff64749c5942213dd9e01c551` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:44.974995 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89068f7ff64749c5942213dd9e01c551)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:44.976945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:45.024703 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89068f7ff64749c5942213dd9e01c551', 'request_id': 'req-1d5fc641-0753-493d-8487-9fd3e8141db6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.031300 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89068f7ff64749c5942213dd9e01c551', 'request_id': 'req-1d5fc641-0753-493d-8487-9fd3e8141db6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.037245 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89068f7ff64749c5942213dd9e01c551', 'request_id': 'req-1d5fc641-0753-493d-8487-9fd3e8141db6'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.052481 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] The token cache is being invalidate because project 89068f7ff64749c5942213dd9e01c551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:31:45.052739 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.053414 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.055049 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1422/2848] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:31:44 2021] DELETE /identity/v3/projects/89068f7ff64749c5942213dd9e01c551 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:45.059320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:45.069655 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2f500-b476-4356-9f5c-0b13a3e1b86c service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:45.128831 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:45.129749 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:45.130023 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:45.130291 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] PATH_INFO: `/v3/users/ae9d569cc5474b578e05927ae1cf066f` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:45.131586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae9d569cc5474b578e05927ae1cf066f)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:45.133558 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:45.185764 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae9d569cc5474b578e05927ae1cf066f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.186428 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae9d569cc5474b578e05927ae1cf066f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.194419 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae9d569cc5474b578e05927ae1cf066f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.207903 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae9d569cc5474b578e05927ae1cf066f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.216538 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-b91f9d69-78f0-41c9-81ea-41c96bc72cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae9d569cc5474b578e05927ae1cf066f'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.222974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1427/2849] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:31:45 2021] DELETE /identity/v3/users/ae9d569cc5474b578e05927ae1cf066f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:45.520647 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:45.523193 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:45.537874 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fc641-0753-493d-8487-9fd3e8141db6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:45.596912 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:45.597892 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:45.598175 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:45.598454 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] PATH_INFO: `/v3/projects/8540b673e2364c86a1a1dcaa313d546a` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:45.599760 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8540b673e2364c86a1a1dcaa313d546a)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:45.601787 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:45.651431 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8540b673e2364c86a1a1dcaa313d546a', 'request_id': 'req-f74da369-b21e-4271-a0e4-b9638897ae3a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.658342 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8540b673e2364c86a1a1dcaa313d546a', 'request_id': 'req-f74da369-b21e-4271-a0e4-b9638897ae3a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.665825 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8540b673e2364c86a1a1dcaa313d546a', 'request_id': 'req-f74da369-b21e-4271-a0e4-b9638897ae3a'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.681016 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] The token cache is being invalidate because project 8540b673e2364c86a1a1dcaa313d546a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:31:45.681308 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.681968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-f74da369-b21e-4271-a0e4-b9638897ae3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:45.683519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1423/2850] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:31:45 2021] DELETE /identity/v3/projects/8540b673e2364c86a1a1dcaa313d546a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:45.689342 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f582cc-54fe-4494-bba2-343ef7cf2f0c None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:45.689911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f582cc-54fe-4494-bba2-343ef7cf2f0c None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:45.689911 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f582cc-54fe-4494-bba2-343ef7cf2f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:45.710069 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-80f582cc-54fe-4494-bba2-343ef7cf2f0c None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:45.711740 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-80f582cc-54fe-4494-bba2-343ef7cf2f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:45.784792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1428/2851] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 16 03:31:45.795887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f966262-b6dc-4067-b456-7eb1881ae0ff None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:45.795887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f966262-b6dc-4067-b456-7eb1881ae0ff None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:45.795887 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f966262-b6dc-4067-b456-7eb1881ae0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:45.817890 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-8f966262-b6dc-4067-b456-7eb1881ae0ff None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:45.819138 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-8f966262-b6dc-4067-b456-7eb1881ae0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:45.828243 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1424/2852] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:45.834064 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f582cc-54fe-4494-bba2-343ef7cf2f0c None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:45.843715 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f582cc-54fe-4494-bba2-343ef7cf2f0c None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:45.848652 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:45.849308 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:45.849618 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:45.849888 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:45.850626 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79351) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 16 03:31:45.850931 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:45.852553 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:45.865369 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1429/2853] 10.222.0.31 () {58 vars in 1152 bytes} [Tue Nov 16 03:31:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 16 03:31:45.871972 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f966262-b6dc-4067-b456-7eb1881ae0ff None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:45.883948 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f966262-b6dc-4067-b456-7eb1881ae0ff None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:45.888968 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:45.889674 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:45.889945 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:45.890220 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] PATH_INFO: `/v3/projects` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:45.890889 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:45.892863 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:45.924676 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1425/2854] 10.222.0.31 () {60 vars in 1152 bytes} [Tue Nov 16 03:31:45 2021] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:45.929853 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:45.943647 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f495d-55ee-4bd0-9724-123b0aaa72b5 admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:46.010585 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:46.011254 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:46.011528 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:46.011792 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] PATH_INFO: `/v3/users` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:46.012501 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:46.014525 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:46.037405 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1430/2855] 10.222.0.31 () {60 vars in 1143 bytes} [Tue Nov 16 03:31:45 2021] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 16 03:31:46.041662 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:46.052311 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c3c741-c73a-4d36-8943-0d417e1be647 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:46.057559 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:46.058223 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:46.058497 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:46.058772 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:46.059519 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:46.061097 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:46.072204 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1426/2856] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:46.076377 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:46.087415 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd2188-560d-4bdc-9555-c088f4c0f51b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:46.092849 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf785d-f2df-4e31-9ab4-002ec786472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:46.093539 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf785d-f2df-4e31-9ab4-002ec786472b admin admin] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:46.093824 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf785d-f2df-4e31-9ab4-002ec786472b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:46.094100 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf785d-f2df-4e31-9ab4-002ec786472b admin admin] PATH_INFO: `/v3/roles` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:46.094845 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf785d-f2df-4e31-9ab4-002ec786472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:46.096489 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf785d-f2df-4e31-9ab4-002ec786472b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:46.106882 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1431/2857] 10.222.0.31 () {58 vars in 1121 bytes} [Tue Nov 16 03:31:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 16 03:31:46.111305 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:46.121736 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2fdc5-7e4a-4e50-9bb9-7a7e3855e0a6 admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:46.127337 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:46.128221 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:46.128499 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:46.128769 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] PATH_INFO: `/v3/projects/ca62b6fc91484132abc805635f35dce0/users/4afa2ac7f094417f9b7c2e5a0b71ae59/roles/b47636c54d4f488b8ee95139571f50ca` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:46.143846 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca62b6fc91484132abc805635f35dce0, user_id=4afa2ac7f094417f9b7c2e5a0b71ae59, role_id=b47636c54d4f488b8ee95139571f50ca)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:46.146513 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:46.162711 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1427/2858] 10.222.0.31 () {60 vars in 1482 bytes} [Tue Nov 16 03:31:46 2021] PUT /identity/v3/projects/ca62b6fc91484132abc805635f35dce0/users/4afa2ac7f094417f9b7c2e5a0b71ae59/roles/b47636c54d4f488b8ee95139571f50ca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:46.178494 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d1132-ae61-4a77-bbb4-a61fd83560d5 None None] REQUEST_METHOD: `POST` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:46.178802 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d1132-ae61-4a77-bbb4-a61fd83560d5 None None] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:46.179121 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d1132-ae61-4a77-bbb4-a61fd83560d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:46.215640 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.auth.core [None req-638d1132-ae61-4a77-bbb4-a61fd83560d5 None None] MFA Rules not processed for user `4afa2ac7f094417f9b7c2e5a0b71ae59`. Rule list: `[]` (Enabled: `True`). {{(pid=79351) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:46.216820 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-638d1132-ae61-4a77-bbb4-a61fd83560d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:46.283799 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1432/2859] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:46 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:46.299298 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:46.302036 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:46.361048 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828ff67-bf32-496f-957d-e1d2fb5f7a5d admin admin] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:46.365560 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4de5b8-bf27-472f-b5fc-8a90827e4518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2904526cac37478bb9fd712ac29f86f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:46.366206 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4de5b8-bf27-472f-b5fc-8a90827e4518 service cinder] REQUEST_METHOD: `GET` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:46.366494 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4de5b8-bf27-472f-b5fc-8a90827e4518 service cinder] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:46.366765 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4de5b8-bf27-472f-b5fc-8a90827e4518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:46.375394 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4de5b8-bf27-472f-b5fc-8a90827e4518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:46.376851 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4de5b8-bf27-472f-b5fc-8a90827e4518 service cinder] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:46.386423 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1428/2860] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:46 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:54.844988 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d1132-ae61-4a77-bbb4-a61fd83560d5 None None] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:54.909974 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d1132-ae61-4a77-bbb4-a61fd83560d5 None None] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:54.915682 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:54.916804 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:54.917081 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:54.917355 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] PATH_INFO: `/v3/users/4afa2ac7f094417f9b7c2e5a0b71ae59` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:54.918658 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afa2ac7f094417f9b7c2e5a0b71ae59)` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:54.920586 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:54.973106 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afa2ac7f094417f9b7c2e5a0b71ae59'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:54.973906 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afa2ac7f094417f9b7c2e5a0b71ae59'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:54.981231 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afa2ac7f094417f9b7c2e5a0b71ae59'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:54.992700 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afa2ac7f094417f9b7c2e5a0b71ae59'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:55.001649 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.notifications [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afa2ac7f094417f9b7c2e5a0b71ae59'} {{(pid=79351) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:55.007595 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1433/2861] 10.222.0.31 () {58 vars in 1223 bytes} [Tue Nov 16 03:31:54 2021] DELETE /identity/v3/users/4afa2ac7f094417f9b7c2e5a0b71ae59 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:31:55.012834 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] REQUEST_METHOD: `POST` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:55.013377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:55.013377 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:55.032147 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.auth.core [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] MFA Rules not processed for user `a95f866674d64e91af100063311f9b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79350) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 16 03:31:55.033759 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:55.103275 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1429/2862] 10.222.0.31 () {58 vars in 957 bytes} [Tue Nov 16 03:31:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 16 03:31:55.115021 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:55.117202 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:55.177154 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568648a-6ad4-43be-9164-fe1dc8ac750b admin admin] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:55.181625 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d09511f0bb7411f9f8c06f49d3a5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:55.182453 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:55.182727 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:55.183001 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:55.192837 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:55.194423 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:55.205046 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1434/2863] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:31:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 16 03:31:55.491631 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] Authenticating user token {{(pid=79350) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:31:55.493112 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.fernet_utils [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79350) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:31:55.505102 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f28538-3e32-4bb4-883a-197098a34ba2 None None] Validating token access rules against request {{(pid=79350) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:31:55.511105 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a95f866674d64e91af100063311f9b6a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb897d934c0d40faa98082f63fe4c388', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79350) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:31:55.512613 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:31:55.513079 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:31:55.513359 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] PATH_INFO: `/v3/projects/ca62b6fc91484132abc805635f35dce0` {{(pid=79350) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:31:55.514981 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca62b6fc91484132abc805635f35dce0)` {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:31:55.516904 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] RBAC: Authorization granted {{(pid=79350) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:31:55.572387 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca62b6fc91484132abc805635f35dce0', 'request_id': 'req-a2f831ae-c77e-4567-ac33-804e3ef8af31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:55.579267 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca62b6fc91484132abc805635f35dce0', 'request_id': 'req-a2f831ae-c77e-4567-ac33-804e3ef8af31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:55.585509 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca62b6fc91484132abc805635f35dce0', 'request_id': 'req-a2f831ae-c77e-4567-ac33-804e3ef8af31'} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:55.599936 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] The token cache is being invalidate because project ca62b6fc91484132abc805635f35dce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79350) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 16 03:31:55.600238 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:55.600836 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: DEBUG keystone.notifications [None req-a2f831ae-c77e-4567-ac33-804e3ef8af31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79350) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 16 03:31:55.602762 dv-cinder-818037-1-iscsi devstack@keystone.service[79350]: [pid: 79350|app: 0|req: 1430/2864] 10.222.0.31 () {58 vars in 1232 bytes} [Tue Nov 16 03:31:55 2021] DELETE /identity/v3/projects/ca62b6fc91484132abc805635f35dce0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 16 03:36:20.244794 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] Authenticating user token {{(pid=79351) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 16 03:36:20.246457 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:36:20.318193 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d60bf-849a-4667-80dc-43d98d0883b8 service neutron] Validating token access rules against request {{(pid=79351) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 16 03:36:20.378049 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c3ac-7dc5-4a7d-9592-f6a2feb3b216 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ef0f0386b384a09a87bcce51d172598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b9c8d5a234af4eadae2610fa7acd3727', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79351) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 16 03:36:20.378688 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c3ac-7dc5-4a7d-9592-f6a2feb3b216 service placement] REQUEST_METHOD: `GET` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 16 03:36:20.378963 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c3ac-7dc5-4a7d-9592-f6a2feb3b216 service placement] SCRIPT_NAME: `/identity` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 16 03:36:20.379226 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c3ac-7dc5-4a7d-9592-f6a2feb3b216 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79351) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 16 03:36:20.381136 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.fernet_utils [None req-fbc6c3ac-7dc5-4a7d-9592-f6a2feb3b216 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79351) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 16 03:36:20.392320 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c3ac-7dc5-4a7d-9592-f6a2feb3b216 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 16 03:36:20.394072 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c3ac-7dc5-4a7d-9592-f6a2feb3b216 service placement] RBAC: Authorization granted {{(pid=79351) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 16 03:36:20.404052 dv-cinder-818037-1-iscsi devstack@keystone.service[79351]: [pid: 79351|app: 0|req: 1435/2865] 10.222.0.31 () {60 vars in 1365 bytes} [Tue Nov 16 03:36:20 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)